Sep 17 14:51:14 devstack cinder-volume[74523]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:51:14 devstack cinder-volume[74523]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:51:14 devstack cinder-volume[74523]: we strongly recommend against using it for new projects. Sep 17 14:51:14 devstack cinder-volume[74523]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:51:14 devstack cinder-volume[74523]: framework. For more detail see Sep 17 14:51:14 devstack cinder-volume[74523]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:51:14 devstack cinder-volume[74523]: import eventlet # noqa Sep 17 14:51:17 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:51:17 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:51:17 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:51:18 devstack cinder-volume[74523]: INFO dbcounter [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Registered counter for database cinder Sep 17 14:51:18 devstack cinder-volume[74523]: DEBUG oslo_db.sqlalchemy.engines [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:18 devstack cinder-volume[74523]: DEBUG dbcounter [-] [74523] Writer thread running {{(pid=74523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:51:18 devstack cinder-volume[74523]: INFO cinder.rpc [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:51:18 devstack cinder-volume[74523]: INFO cinder.rpc [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:51:18 devstack cinder-volume[74523]: DEBUG oslo_db.sqlalchemy.engines [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:18 devstack cinder-volume[74523]: INFO cinder.volume.manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Determined volume DB was empty at startup. Sep 17 14:51:18 devstack cinder-volume[74523]: DEBUG cinder.volume.manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=74523) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:51:19 devstack cinder-volume[74523]: INFO cinder.volume.manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 14:51:19 devstack cinder-volume[74523]: WARNING stevedore.named [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:51:19 devstack cinder-volume[74523]: WARNING castellan.key_manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:51:19 devstack cinder-volume[74523]: WARNING cinder.keymgr.conf_key_mgr [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG cinder.volume.drivers.lvm [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=74523) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_concurrency.processutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=74523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_concurrency.processutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.475s {{(pid=74523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_db.sqlalchemy.engines [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:19 devstack cinder-volume[74523]: INFO cinder.rpc [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 17 14:51:19 devstack cinder-volume[74523]: INFO cinder.rpc [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 17 14:51:19 devstack cinder-volume[74523]: WARNING stevedore.named [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:51:19 devstack cinder-volume[74523]: WARNING castellan.key_manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:51:19 devstack cinder-volume[74523]: INFO cinder.volume.manager [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_db.sqlalchemy.engines [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:19 devstack cinder-volume[74523]: INFO oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Starting 1 workers Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Started child 74689 {{(pid=74523) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Full set of CONF: {{(pid=74523) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] ******************************************************************************** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Configuration options gathered from: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] ================================================================================ {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] allow_availability_zone_fallback = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] allow_compression_on_image_upload = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] allowed_direct_url_schemes = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] api_rate_limit = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] auth_strategy = keystone {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] az_cache_duration = 3600 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_availability_zone = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_host = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_stats_polling_interval = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backup_api_class = cinder.backup.api.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backup_name_template = backup-%s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backup_use_same_host = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backup_use_temp_snapshot = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] chap_password = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] chap_username = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_internal_tenant_project_id = bb00d296b32f47689ee0491568c348ab {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_internal_tenant_user_id = 8b09a682097c4c84af6aacb0810c61f6 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cloned_volume_same_az = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cluster = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] compression_format = gzip {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] compute_api_class = cinder.compute.nova.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] config_dir = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] config_source = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] control_exchange = openstack {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] debug = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] default_availability_zone = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] default_group_type = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] default_volume_type = lvmdriver-1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] disk_geometry = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_client_cert = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_client_cert_key = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_data_namespace = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_ssl_cert_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_ssl_cert_verify = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] driver_use_ssl = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] enable_force_upload = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] enable_new_services = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] enable_unsupported_driver = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] enforce_multipath_for_image_xfer = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] filter_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_api_insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_api_ssl_compression = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_ca_certificates_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_catalog_info = image:glance:publicURL {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_num_retries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance_request_timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] goodness_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] graceful_shutdown_timeout = 5 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] group_api_class = cinder.group.api.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] host = devstack {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_compress_on_upload = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_conversion_address_space_limit = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: INFO cinder.volume.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_conversion_cpu_limit = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_conversion_disable = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_upload_use_cinder_backend = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_upload_use_internal_tenant = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_volume_cache_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_volume_cache_max_count = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] image_volume_cache_max_size_gb = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] init_host_max_objects_retrieval = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] instance_format = [instance: %(uuid)s] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iscsi_target_flags = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iscsi_write_cache = on {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iser_helper = tgtadm {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iser_ip_address = 192.168.122.74 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iser_port = 3260 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_color = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_config_append = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_dir = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_options = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_rotate_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_rotate_interval_type = days {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] log_rotation_type = none {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] max_age = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] max_logfile_count = 30 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] max_logfile_size_mb = 200 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] max_over_subscription_ratio = 20.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] message_reap_interval = 86400 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] message_ttl = 2592000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] migration_create_volume_timeout_secs = 300 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] monkey_patch = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] monkey_patch_modules = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] my_ip = 192.168.122.74 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] no_snapshot_gb_quota = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] num_iser_scan_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] num_shell_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] num_volume_device_scan_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] nvmeof_conn_info_version = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] nvmet_ns_id = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] nvmet_port_id = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_max_limit = 1000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_ext_list = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_listen_port = 8776 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_use_ssl = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] osapi_volume_workers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] per_volume_size_limit = -1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] periodic_fuzzy_delay = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] periodic_interval = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] public_endpoint = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] publish_errors = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_backup_gigabytes = 1000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_backups = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_gigabytes = 1000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_groups = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_snapshots = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] quota_volumes = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] rate_limit_burst = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] rate_limit_except_level = CRITICAL {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] rate_limit_interval = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] reinit_driver_count = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] replication_device = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] report_discard_supported = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] report_interval = 120 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] reservation_clean_interval = 86400 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] reservation_expire = 86400 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] reserved_image_namespaces = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] reserved_percentage = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] rpc_response_timeout = 120 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] run_external_periodic_tasks = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] scst_target_driver = iscsi {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] scst_target_iqn_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_down_time = 720 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] shell_completion = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] snapshot_name_template = snapshot-%s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] snapshot_same_host = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] split_loggers = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] state_path = /opt/stack/data/cinder {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] storage_availability_zone = nova {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] storage_protocol = iSCSI {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] syslog_log_facility = LOG_USER {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_helper = lioadm {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_ip_address = 192.168.122.74 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_port = 3260 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_protocol = iscsi {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] target_secondary_ip_addresses = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] trace_flags = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] transport_url = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] until_refresh = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_chap_auth = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_default_quota_class = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_journal = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_json = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_multipath_for_image_xfer = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_stderr = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] use_syslog = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] verify_glance_signatures = enabled {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_api_class = cinder.volume.api.API {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_backend_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_clear = zero {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_clear_ionice = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_clear_size = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_copy_bps_limit = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_dd_blocksize = 1M {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_name_template = volume-%s {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_service_inithost_offload = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volume_usage_audit_period = month {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] zoning_mode = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_concurrency.disable_process_locking = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.auth_section = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.auth_type = password {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.auth_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.cache = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.include_service_catalog = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.interface = public {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_password = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcache_username = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.region_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.service_type = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.backend = dogpile.cache.null {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.backend_argument = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.backend_expiration_time = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.config_prefix = cache.oslo {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.debug_cache_backend = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.enable_retry_client = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.enable_socket_keepalive = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.expiration_time = 600 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.hashclient_retry_attempts = 2 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_dead_retry = 300 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_pool_maxsize = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_sasl_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.password = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.proxies = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.redis_db = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.redis_server = localhost:6379 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.retry_attempts = 2 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.retry_delay = 0.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.socket_keepalive_count = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.socket_keepalive_idle = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.socket_keepalive_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.socket_timeout = 1.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.tls_allowed_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.tls_cafile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.tls_certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.tls_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.tls_keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cache.username = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] coordination.backend_url = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.asyncio_connection = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.asyncio_slave_connection = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.backend = sqlalchemy {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.connection = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.connection_debug = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.connection_parameters = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.connection_recycle_time = 3600 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.connection_trace = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.db_inc_retry_interval = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.db_max_retries = 20 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.db_max_retry_interval = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.db_retry_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.max_overflow = 50 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.max_pool_size = 5 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.max_retries = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.mysql_wsrep_sync_wait = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.pool_timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.retry_interval = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.slave_connection = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.sqlite_synchronous = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.synchronous_reader = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] database.use_db_reconnect = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_tracing.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.connection_string = messaging:// {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.es_doc_type = notification {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.es_scroll_size = 10000 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.es_scroll_time = 2m {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.filter_error_trace = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.hmac_keys = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.sentinel_service_name = mymaster {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.socket_timeout = 0.1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.trace_requests = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler.trace_sqlalchemy = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler_jaeger.process_tags = {} {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler_jaeger.service_name_prefix = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] profiler_otlp.service_name_prefix = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.enforce_new_defaults = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.policy_default_rule = default {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.policy_file = policy.yaml {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.group = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.helper_command = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] privsep_osbrick.user = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.group = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.helper_command = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] cinder_sys_admin.user = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.auth_section = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.auth_type = password {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.cafile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.collect_timing = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.send_service_user_token = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.split_loggers = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.tls_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] service_user.tls_min_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.auth_section = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.auth_type = password {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.collect_timing = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.region_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.split_loggers = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.tls_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] glance.tls_min_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.backend_availability_zone = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.chap_password = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.chap_username = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.disk_geometry = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_client_cert = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_client_cert_key = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_data_namespace = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.driver_use_ssl = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:19 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.extra_capabilities = {} {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.filter_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.goodness_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iscsi_target_flags = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iscsi_write_cache = on {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iser_helper = tgtadm {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iser_port = 3260 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.lvm_share_target = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.lvm_type = auto {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.num_shell_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.replication_device = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.report_discard_supported = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.reserved_percentage = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack sudo[74693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_helper = tgtadm {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_port = 3260 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack sudo[74693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_protocol = iscsi {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.trace_flags = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.unique_fqdn_network = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.use_chap_auth = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_backend_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_clear = zero {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_clear_ionice = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_clear_size = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_reports.file_event_handler = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_reports.log_dir = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.backend_host = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.chap_password = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.chap_username = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.disk_geometry = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_client_cert = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.extra_capabilities = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.filter_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.goodness_function = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iser_helper = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iser_ip_address = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iser_port = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.lvm_share_target = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.lvm_type = auto {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.num_shell_tries = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.replication_device = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.report_discard_supported = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.reserved_percentage = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.scst_target_driver = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.storage_protocol = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_helper = lioadm {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_ip_address = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_port = 3260 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.trace_flags = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.use_chap_auth = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_clear = zero {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_clear_size = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] lvmdriver-1.volumes_dir = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_notifications.driver = [] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_notifications.retry = -1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] key_manager.fixed_key = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.barbican_api_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.barbican_endpoint = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.barbican_endpoint_type = public {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.barbican_region_name = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.cafile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.collect_timing = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.number_of_retries = 60 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.retry_delay = 1 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.send_service_user_token = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.split_loggers = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.tls_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.tls_min_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.verify_ssl = True {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican.verify_ssl_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.auth_section = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.auth_type = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.cafile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.certfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.collect_timing = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.insecure = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.keyfile = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.split_loggers = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.timeout = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.tls_ciphers = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] barbican_service_user.tls_min_version = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.approle_role_id = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.approle_secret_id = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.auth_method = approle {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.auth_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.kv_mountpoint = secret {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.kv_path = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.kv_version = 2 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.namespace = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.root_token_id = **** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.ssl_ca_crt_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.timeout = 60.0 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.token_file = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.token_role = None {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.use_ssl = False {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:51:20 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] ******************************************************************************** {{(pid=74523) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:51:20 devstack sudo[74693]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:20 devstack sudo[74782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:20 devstack sudo[74782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:20 devstack sudo[74782]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.255s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 14:51:20 devstack cinder-volume[74689]: INFO cinder.brick.local_dev.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:20 devstack sudo[74897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:20 devstack sudo[74897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:20 devstack sudo[74897]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG cinder.brick.local_dev.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=74689) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 17 14:51:20 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:20 devstack sudo[74977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:20 devstack sudo[74977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:21 devstack sudo[74977]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.533s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:21 devstack sudo[75174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:21 devstack sudo[75174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:21 devstack sudo[75174]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:21 devstack sudo[75293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 17 14:51:21 devstack sudo[75293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:21 devstack sudo[75293]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.294s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:21 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:21 devstack sudo[75297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:21 devstack sudo[75297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:22 devstack sudo[75297]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:22 devstack sudo[75380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:22 devstack sudo[75380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:22 devstack sudo[75380]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:22 devstack sudo[75383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:22 devstack sudo[75383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:22 devstack sudo[75383]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:22 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:22 devstack sudo[75404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:22 devstack sudo[75404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:23 devstack sudo[75404]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.290s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:23 devstack sudo[75482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:23 devstack sudo[75482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:23 devstack sudo[75482]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:23 devstack cinder-volume[74689]: INFO cinder.volume.drivers.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:23 devstack sudo[75486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:23 devstack sudo[75486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:23 devstack sudo[75486]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:23 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:23 devstack sudo[75489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:23 devstack sudo[75489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:24 devstack sudo[75489]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:24 devstack sudo[75492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:24 devstack sudo[75492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:24 devstack sudo[75492]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:24 devstack sudo[75495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:24 devstack sudo[75495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:24 devstack sudo[75495]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:24 devstack sudo[75498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:24 devstack sudo[75498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:24 devstack sudo[75498]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:24 devstack cinder-volume[74689]: INFO cinder.volume.driver [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG cinder.volume.driver [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=74689) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_db.sqlalchemy.engines [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=74689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writer thread running {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG cinder.db.api [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Building query based on filter {{(pid=74689) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG cinder.image.image_utils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=74689) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 14:51:24 devstack cinder-volume[74689]: INFO cinder.keymgr.migration [None req-2ca21092-134c-4235-ab82-8bdb7185143e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:24 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:25 devstack sudo[75502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:25 devstack sudo[75502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:25 devstack sudo[75502]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:25 devstack sudo[75507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:25 devstack sudo[75507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:25 devstack sudo[75507]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:25 devstack sudo[75510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:25 devstack sudo[75510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:25 devstack sudo[75510]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:25 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:25 devstack sudo[75513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:25 devstack sudo[75513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:26 devstack sudo[75513]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG cinder.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Notifying Schedulers of capabilities ... {{(pid=74689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:51:26 devstack cinder-volume[74689]: INFO cinder.volume.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Driver initialization completed successfully. Sep 17 14:51:26 devstack cinder-volume[74689]: INFO cinder.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Initiating service 2 cleanup Sep 17 14:51:26 devstack cinder-volume[74689]: INFO cinder.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Service 2 cleanup completed. Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG cinder.service [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Creating RPC server for service cinder-volume {{(pid=74689) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG cinder.service [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=74689) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:51:26 devstack cinder-volume[74689]: INFO cinder.volume.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:26 devstack sudo[75550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:51:26 devstack sudo[75550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:26 devstack sudo[75550]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:26 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:26 devstack sudo[75560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:26 devstack sudo[75560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:27 devstack sudo[75560]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:27 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:27 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:27 devstack sudo[75563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:51:27 devstack sudo[75563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:27 devstack sudo[75563]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:27 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:27 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:51:27 devstack sudo[75566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:51:27 devstack sudo[75566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:51:27 devstack sudo[75566]: pam_unix(sudo:session): session closed for user root Sep 17 14:51:27 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:51:27 devstack cinder-volume[74689]: INFO cinder.volume.manager [None req-7c033521-d132-4e81-9634-e0470fc1673a None None] Driver post RPC initialization completed successfully. Sep 17 14:51:29 devstack cinder-volume[74523]: DEBUG dbcounter [-] [74523] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:36 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:37 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:51:59 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager._thread_info {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:51:59 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread count: 6 {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:51:59 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread info: [<_MainThread(MainThread, started 123893549555840)>, , , , , ] {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:52:59 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:52:59 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:52:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:59 devstack sudo[80023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:52:59 devstack sudo[80023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:52:59 devstack sudo[80023]: pam_unix(sudo:session): session closed for user root Sep 17 14:52:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:52:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:52:59 devstack sudo[80160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:52:59 devstack sudo[80160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:00 devstack sudo[80160]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:00 devstack sudo[80339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:53:00 devstack sudo[80339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:00 devstack sudo[80339]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:00 devstack sudo[80483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:53:00 devstack sudo[80483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:00 devstack sudo[80483]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG cinder.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Notifying Schedulers of capabilities ... {{(pid=74689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager._thread_info {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread count: 6 {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:53:00 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread info: [<_MainThread(MainThread, started 123893549555840)>, , , , , ] {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:53:37 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:53:59 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:53:59 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:53:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:59 devstack sudo[82162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:53:59 devstack sudo[82162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:53:59 devstack sudo[82162]: pam_unix(sudo:session): session closed for user root Sep 17 14:53:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:53:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:53:59 devstack sudo[82166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:53:59 devstack sudo[82166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:00 devstack sudo[82166]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:00 devstack sudo[82178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:54:00 devstack sudo[82178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:00 devstack sudo[82178]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:00 devstack sudo[82182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:54:00 devstack sudo[82182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:00 devstack sudo[82182]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:00 devstack cinder-volume[74689]: DEBUG cinder.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Notifying Schedulers of capabilities ... {{(pid=74689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:54:59 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:54:59 devstack cinder-volume[74689]: DEBUG cinder.volume.drivers.lvm [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Updating volume stats {{(pid=74689) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 17 14:54:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:59 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 17 14:54:59 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:54:59 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Sep 17 14:54:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:54:59 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:54:59 devstack sudo[83707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:54:59 devstack sudo[83707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:00 devstack sudo[83707]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:00 devstack sudo[83711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 17 14:55:00 devstack sudo[83711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:00 devstack sudo[83711]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:00 devstack sudo[83714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 17 14:55:00 devstack sudo[83714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:00 devstack sudo[83714]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_concurrency.processutils [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=74689) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG cinder.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Notifying Schedulers of capabilities ... {{(pid=74689) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG oslo_service.periodic_task [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] Running periodic task VolumeManager._thread_info {{(pid=74689) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread count: 6 {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:55:00 devstack cinder-volume[74689]: DEBUG cinder.volume.manager [None req-fb14ef81-2402-4f70-a7bc-245ae6acb967 None None] thread info: [<_MainThread(MainThread, started 123893549555840)>, , , , , ] {{(pid=74689) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:55:37 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writing DB stats cinder:SELECT=1 {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:37 devstack cinder-volume[74689]: DEBUG dbcounter [-] [74689] Writing DB stats cinder:UPDATE=1 {{(pid=74689) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:55:43 devstack cinder-volume[74523]: INFO oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Caught SIGTERM, stopping children Sep 17 14:55:43 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Acquiring lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:43 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Acquired lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:43 devstack cinder-volume[74523]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Releasing lock "singleton_lock" {{(pid=74523) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:43 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Stop services. {{(pid=74523) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 14:55:43 devstack cinder-volume[74523]: DEBUG oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Killing children. {{(pid=74523) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 14:55:43 devstack cinder-volume[74523]: INFO oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Waiting on 1 children to exit Sep 17 14:55:46 devstack cinder-volume[74689]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Acquiring lock "singleton_lock" {{(pid=74689) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:46 devstack cinder-volume[74689]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Acquired lock "singleton_lock" {{(pid=74689) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:46 devstack cinder-volume[74689]: DEBUG oslo_concurrency.lockutils [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Releasing lock "singleton_lock" {{(pid=74689) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:46 devstack cinder-volume[74689]: WARNING amqp [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:46 devstack cinder-volume[74689]: WARNING amqp [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:55:46 devstack cinder-volume[74523]: INFO oslo_service.backend._eventlet.service [None req-934f7832-3f49-48f4-8989-5ba762d829d7 None None] Child 74689 exited with status 0 Sep 17 14:55:46 devstack cinder-volume[85116]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:55:46 devstack cinder-volume[85116]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:55:46 devstack cinder-volume[85116]: we strongly recommend against using it for new projects. Sep 17 14:55:46 devstack cinder-volume[85116]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:55:46 devstack cinder-volume[85116]: framework. For more detail see Sep 17 14:55:46 devstack cinder-volume[85116]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:55:46 devstack cinder-volume[85116]: import eventlet # noqa Sep 17 14:55:48 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:48 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:48 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:49 devstack cinder-volume[85116]: INFO dbcounter [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Registered counter for database cinder Sep 17 14:55:49 devstack cinder-volume[85116]: DEBUG oslo_db.sqlalchemy.engines [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:49 devstack cinder-volume[85116]: DEBUG dbcounter [-] [85116] Writer thread running {{(pid=85116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:49 devstack cinder-volume[85116]: INFO cinder.rpc [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:55:49 devstack cinder-volume[85116]: INFO cinder.rpc [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_db.sqlalchemy.engines [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:50 devstack cinder-volume[85116]: INFO cinder.volume.manager [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Determined volume DB was empty at startup. Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG cinder.volume.manager [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85116) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:55:50 devstack cinder-volume[85116]: INFO cinder.volume.manager [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 17 14:55:50 devstack cinder-volume[85116]: WARNING stevedore.named [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:55:50 devstack cinder-volume[85116]: WARNING castellan.key_manager [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:50 devstack cinder-volume[85116]: WARNING cinder.keymgr.conf_key_mgr [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:55:50 devstack cinder-volume[85116]: INFO cinder.volume.manager [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_db.sqlalchemy.engines [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:50 devstack cinder-volume[85116]: INFO oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Starting 1 workers Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Started child 85337 {{(pid=85116) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Full set of CONF: {{(pid=85116) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] ******************************************************************************** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Configuration options gathered from: {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] ================================================================================ {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] allow_availability_zone_fallback = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] allow_compression_on_image_upload = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] allowed_direct_url_schemes = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] api_rate_limit = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] auth_strategy = keystone {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85337]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_availability_zone = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_host = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_stats_polling_interval = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backup_api_class = cinder.backup.api.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backup_name_template = backup-%s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backup_use_same_host = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backup_use_temp_snapshot = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] chap_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] chap_username = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_internal_tenant_project_id = bb00d296b32f47689ee0491568c348ab {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_internal_tenant_user_id = 8b09a682097c4c84af6aacb0810c61f6 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cluster = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] compression_format = gzip {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] compute_api_class = cinder.compute.nova.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] config_dir = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] config_source = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] control_exchange = openstack {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] debug = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] default_availability_zone = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] default_group_type = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] default_volume_type = QuobyteHD {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] disk_geometry = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_client_cert = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_client_cert_key = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_data_namespace = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_ssl_cert_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_ssl_cert_verify = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] driver_use_ssl = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] enable_new_services = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] enable_unsupported_driver = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] enabled_backends = ['QuobyteHD'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] enforce_multipath_for_image_xfer = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] filter_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_api_insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_api_ssl_compression = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_ca_certificates_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_catalog_info = image:glance:publicURL {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_num_retries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance_request_timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] goodness_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] graceful_shutdown_timeout = 5 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] group_api_class = cinder.group.api.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] host = devstack {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_compress_on_upload = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_conversion_address_space_limit = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_conversion_cpu_limit = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_conversion_disable = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_upload_use_cinder_backend = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_upload_use_internal_tenant = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_volume_cache_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_volume_cache_max_count = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] image_volume_cache_max_size_gb = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] init_host_max_objects_retrieval = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] instance_format = [instance: %(uuid)s] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iscsi_target_flags = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iscsi_write_cache = on {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iser_helper = tgtadm {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iser_ip_address = 192.168.122.74 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iser_port = 3260 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_color = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_config_append = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_dir = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_options = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_rotate_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_rotate_interval_type = days {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] log_rotation_type = none {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] max_age = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] max_logfile_count = 30 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] max_logfile_size_mb = 200 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] max_over_subscription_ratio = 20.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] message_reap_interval = 86400 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] message_ttl = 2592000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] migration_create_volume_timeout_secs = 300 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] monkey_patch = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] monkey_patch_modules = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] my_ip = 192.168.122.74 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] no_snapshot_gb_quota = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] num_iser_scan_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] num_shell_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] num_volume_device_scan_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] nvmeof_conn_info_version = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] nvmet_ns_id = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] nvmet_port_id = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_max_limit = 1000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.remotefs [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85337) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_ext_list = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_listen_port = 8776 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_use_ssl = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] osapi_volume_workers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] per_volume_size_limit = -1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] periodic_fuzzy_delay = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] periodic_interval = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] public_endpoint = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] publish_errors = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_backup_gigabytes = 1000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_backups = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_gigabytes = 1000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_groups = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_snapshots = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] quota_volumes = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] rate_limit_burst = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] rate_limit_except_level = CRITICAL {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] rate_limit_interval = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] reinit_driver_count = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] replication_device = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] report_discard_supported = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] report_interval = 120 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] reservation_clean_interval = 86400 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] reservation_expire = 86400 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] reserved_image_namespaces = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] reserved_percentage = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] rpc_response_timeout = 120 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] run_external_periodic_tasks = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] scst_target_driver = iscsi {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] scst_target_iqn_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_down_time = 720 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] shell_completion = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] snapshot_name_template = snapshot-%s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] split_loggers = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] state_path = /opt/stack/data/cinder {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] storage_availability_zone = nova {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] storage_protocol = iSCSI {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] syslog_log_facility = LOG_USER {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_helper = lioadm {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_ip_address = 192.168.122.74 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_port = 3260 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_protocol = iscsi {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] target_secondary_ip_addresses = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] trace_flags = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] transport_url = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] until_refresh = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_chap_auth = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_default_quota_class = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_journal = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_json = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_multipath_for_image_xfer = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_stderr = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] use_syslog = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] verify_glance_signatures = enabled {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_api_class = cinder.volume.api.API {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_backend_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_clear = zero {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_clear_ionice = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_clear_size = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_copy_bps_limit = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_dd_blocksize = 1M {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_name_template = volume-%s {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_service_inithost_offload = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volume_usage_audit_period = month {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] zoning_mode = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_concurrency.disable_process_locking = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.auth_section = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.auth_type = password {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.auth_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.cache = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.include_service_catalog = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.interface = public {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85337) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 14:55:50 devstack cinder-volume[85337]: WARNING cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 14:55:50 devstack cinder-volume[85337]: WARNING cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Running cmd (subprocess): mount.quobyte {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcache_username = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.region_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.service_type = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.backend = dogpile.cache.null {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.backend_argument = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.backend_expiration_time = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.config_prefix = cache.oslo {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.debug_cache_backend = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.enable_retry_client = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.enable_socket_keepalive = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.expiration_time = 600 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.hashclient_retry_attempts = 2 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_dead_retry = 300 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_pool_maxsize = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_sasl_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.proxies = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.redis_db = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.redis_server = localhost:6379 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.retry_attempts = 2 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.retry_delay = 0.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.socket_keepalive_count = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.socket_keepalive_idle = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.socket_keepalive_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.socket_timeout = 1.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.tls_allowed_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.tls_cafile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.tls_certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.tls_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.tls_keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cache.username = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] coordination.backend_url = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.asyncio_connection = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.asyncio_slave_connection = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.backend = sqlalchemy {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.connection = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.connection_debug = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.connection_parameters = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.connection_recycle_time = 3600 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.connection_trace = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.db_inc_retry_interval = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.db_max_retries = 20 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.db_max_retry_interval = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.db_retry_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.max_overflow = 50 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.max_pool_size = 5 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.max_retries = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.mysql_wsrep_sync_wait = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.pool_timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.retry_interval = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.slave_connection = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.sqlite_synchronous = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.synchronous_reader = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] database.use_db_reconnect = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_tracing.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.connection_string = messaging:// {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.es_doc_type = notification {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.es_scroll_size = 10000 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.es_scroll_time = 2m {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.filter_error_trace = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.hmac_keys = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.sentinel_service_name = mymaster {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.socket_timeout = 0.1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.trace_requests = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler.trace_sqlalchemy = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler_jaeger.process_tags = {} {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler_jaeger.service_name_prefix = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] profiler_otlp.service_name_prefix = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.enforce_new_defaults = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.policy_default_rule = default {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.policy_file = policy.yaml {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.group = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.helper_command = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] privsep_osbrick.user = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.group = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.helper_command = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack quobyte-client[85342]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 14:55:50 devstack quobyte-client[85342]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] cinder_sys_admin.user = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.auth_section = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.auth_type = password {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.cafile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.collect_timing = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.send_service_user_token = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.split_loggers = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: INFO cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 ... Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.tls_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] service_user.tls_min_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 -c /etc/quobyte/client-cinder.cfg {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.auth_section = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.auth_type = password {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.collect_timing = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.region_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.split_loggers = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.tls_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] glance.tls_min_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.backend_availability_zone = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.chap_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.chap_username = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.disk_geometry = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_client_cert = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_client_cert_key = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_data_namespace = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.driver_use_ssl = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.extra_capabilities = {} {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.filter_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.goodness_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iscsi_target_flags = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iscsi_write_cache = on {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iser_helper = tgtadm {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iser_port = 3260 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_host = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 -c /etc/quobyte/client-cinder.cfg Sep 17 14:55:50 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_login = admin {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_mount_options = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_private_key = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_share_path = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.num_shell_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.quobyte_volume_url = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.replication_device = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.report_discard_supported = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.reserved_percentage = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_helper = tgtadm {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_port = 3260 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_protocol = iscsi {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.trace_flags = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.unique_fqdn_network = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.use_chap_auth = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_backend_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_clear = zero {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_clear_ionice = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_clear_size = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_reports.file_event_handler = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_reports.log_dir = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.backend_availability_zone = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.backend_host = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.chap_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.chap_username = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.chiscsi_conf = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.disk_geometry = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_client_cert = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_data_namespace = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.driver_use_ssl = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.extra_capabilities = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.filter_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.goodness_function = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iser_helper = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iser_ip_address = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iser_port = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.iser_target_prefix = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_host = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_login = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_mount_options = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_password = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_private_key = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_share_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_ssh_port = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.num_shell_tries = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.nvmet_port_id = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.replication_device = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.report_discard_supported = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.reserved_percentage = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.scst_target_driver = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.storage_protocol = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_helper = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_ip_address = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_port = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_prefix = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_protocol = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.trace_flags = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.use_chap_auth = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_clear = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_clear_size = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] QuobyteHD.volumes_dir = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_notifications.driver = [] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_notifications.retry = -1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] key_manager.fixed_key = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.barbican_api_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.barbican_endpoint = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.barbican_endpoint_type = public {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.barbican_region_name = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.cafile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.collect_timing = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.number_of_retries = 60 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.retry_delay = 1 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.send_service_user_token = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.split_loggers = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.tls_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.tls_min_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.verify_ssl = True {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican.verify_ssl_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.auth_section = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.auth_type = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.cafile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.certfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.collect_timing = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.insecure = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.keyfile = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.split_loggers = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.timeout = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.tls_ciphers = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] barbican_service_user.tls_min_version = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.approle_role_id = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.approle_secret_id = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.auth_method = approle {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.auth_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.kv_mountpoint = secret {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.kv_path = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.kv_version = 2 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.namespace = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.root_token_id = **** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.ssl_ca_crt_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.timeout = 60.0 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.token_file = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.token_role = None {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.use_ssl = False {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:55:50 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] ******************************************************************************** {{(pid=85116) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:55:50 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.411s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:50 devstack cinder-volume[85337]: INFO cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 succeeded Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.426s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:50 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:50 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:55:50 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:51 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.250s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.volume.driver [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.volume.driver [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85337) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_db.sqlalchemy.engines [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG dbcounter [-] [85337] Writer thread running {{(pid=85337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.db.api [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Building query based on filter {{(pid=85337) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.image.image_utils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85337) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.keymgr.migration [None req-f943e816-c66a-4522-b73f-cf2d5cf006b5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:51 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:55:51 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:51 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.241s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Notifying Schedulers of capabilities ... {{(pid=85337) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Driver initialization completed successfully. Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Initiating service 3 cleanup Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Service 3 cleanup completed. Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.service [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Creating RPC server for service cinder-volume {{(pid=85337) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.service [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85337) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:55:51 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85337) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG cinder.volume.drivers.quobyte [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85337) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85337) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:55:51 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:55:51 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:55:51 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:55:52 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Sep 17 14:55:52 devstack cinder-volume[85337]: DEBUG oslo_concurrency.processutils [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.265s {{(pid=85337) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:55:52 devstack cinder-volume[85337]: INFO cinder.volume.manager [None req-84e57a01-fb44-4e10-9f2d-dc54492c521e None None] Driver post RPC initialization completed successfully. Sep 17 14:55:55 devstack cinder-volume[85116]: INFO oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Caught SIGTERM, stopping children Sep 17 14:55:55 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Acquiring lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:55:55 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Acquired lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:55:55 devstack cinder-volume[85116]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Releasing lock "singleton_lock" {{(pid=85116) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:55:55 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Stop services. {{(pid=85116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 17 14:55:55 devstack cinder-volume[85116]: DEBUG oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Killing children. {{(pid=85116) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 17 14:55:55 devstack cinder-volume[85116]: INFO oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Waiting on 1 children to exit Sep 17 14:56:00 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Acquiring lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:56:00 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Acquired lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:56:00 devstack cinder-volume[85337]: DEBUG oslo_concurrency.lockutils [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Releasing lock "singleton_lock" {{(pid=85337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:56:00 devstack cinder-volume[85337]: WARNING amqp [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:56:00 devstack cinder-volume[85337]: WARNING amqp [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 17 14:56:00 devstack cinder-volume[85116]: INFO oslo_service.backend._eventlet.service [None req-aefcb002-2761-4422-ae48-0afdea9e6325 None None] Child 85337 exited with status 0 Sep 17 14:56:00 devstack cinder-volume[85666]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 17 14:56:00 devstack cinder-volume[85666]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:56:00 devstack cinder-volume[85666]: we strongly recommend against using it for new projects. Sep 17 14:56:00 devstack cinder-volume[85666]: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:56:00 devstack cinder-volume[85666]: framework. For more detail see Sep 17 14:56:00 devstack cinder-volume[85666]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:56:00 devstack cinder-volume[85666]: import eventlet # noqa Sep 17 14:56:03 devstack cinder-volume[85666]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 17 14:56:03 devstack cinder-volume[85666]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 17 14:56:03 devstack cinder-volume[85666]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85666) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 17 14:56:03 devstack cinder-volume[85666]: INFO dbcounter [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Registered counter for database cinder Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_db.sqlalchemy.engines [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG dbcounter [-] [85666] Writer thread running {{(pid=85666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:56:04 devstack cinder-volume[85666]: INFO cinder.rpc [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 17 14:56:04 devstack cinder-volume[85666]: INFO cinder.rpc [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_db.sqlalchemy.engines [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:56:04 devstack cinder-volume[85666]: INFO cinder.volume.manager [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Determined volume DB was empty at startup. Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG cinder.volume.manager [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85666) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 17 14:56:04 devstack cinder-volume[85666]: WARNING stevedore.named [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 17 14:56:04 devstack cinder-volume[85666]: WARNING castellan.key_manager [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:56:04 devstack cinder-volume[85666]: WARNING cinder.keymgr.conf_key_mgr [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 17 14:56:04 devstack cinder-volume[85666]: INFO cinder.volume.manager [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_db.sqlalchemy.engines [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85666) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:56:04 devstack cinder-volume[85666]: INFO oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Starting 1 workers Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Started child 85963 {{(pid=85666) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Full set of CONF: {{(pid=85666) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] ******************************************************************************** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] Configuration options gathered from: {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] ================================================================================ {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] allow_availability_zone_fallback = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] allow_compression_on_image_upload = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] allowed_direct_url_schemes = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] api_rate_limit = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] auth_strategy = keystone {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_availability_zone = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_host = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_stats_polling_interval = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backup_api_class = cinder.backup.api.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backup_name_template = backup-%s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85963]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backup_use_same_host = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backup_use_temp_snapshot = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] chap_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] chap_username = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_internal_tenant_project_id = bb00d296b32f47689ee0491568c348ab {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_internal_tenant_user_id = 8b09a682097c4c84af6aacb0810c61f6 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cluster = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] compression_format = gzip {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] compute_api_class = cinder.compute.nova.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] config_dir = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] config_source = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] control_exchange = openstack {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] debug = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] default_availability_zone = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] default_group_type = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] default_volume_type = QuobyteHD {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] disk_geometry = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_client_cert = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_client_cert_key = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_data_namespace = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_ssl_cert_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_ssl_cert_verify = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] driver_use_ssl = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] enable_new_services = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] enable_unsupported_driver = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] enabled_backends = ['QuobyteHD'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] enforce_multipath_for_image_xfer = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] filter_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_api_insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_api_ssl_compression = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_ca_certificates_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_catalog_info = image:glance:publicURL {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_num_retries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance_request_timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] goodness_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] graceful_shutdown_timeout = 5 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] group_api_class = cinder.group.api.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] host = devstack {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_compress_on_upload = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_conversion_address_space_limit = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_conversion_cpu_limit = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_conversion_disable = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_upload_use_cinder_backend = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_upload_use_internal_tenant = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_volume_cache_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_volume_cache_max_count = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] image_volume_cache_max_size_gb = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] init_host_max_objects_retrieval = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] instance_format = [instance: %(uuid)s] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iscsi_target_flags = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iscsi_write_cache = on {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iser_helper = tgtadm {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iser_ip_address = 192.168.122.74 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iser_port = 3260 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_color = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_config_append = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_dir = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_options = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_rotate_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_rotate_interval_type = days {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] log_rotation_type = none {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] max_age = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] max_logfile_count = 30 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] max_logfile_size_mb = 200 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] max_over_subscription_ratio = 20.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] message_reap_interval = 86400 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] message_ttl = 2592000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] migration_create_volume_timeout_secs = 300 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] monkey_patch = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] monkey_patch_modules = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] my_ip = 192.168.122.74 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] no_snapshot_gb_quota = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] num_iser_scan_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] num_shell_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] num_volume_device_scan_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] nvmeof_conn_info_version = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] nvmet_ns_id = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] nvmet_port_id = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_max_limit = 1000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_ext_list = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_listen_port = 8776 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_use_ssl = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] osapi_volume_workers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] per_volume_size_limit = -1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] periodic_fuzzy_delay = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] periodic_interval = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] public_endpoint = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] publish_errors = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_backup_gigabytes = 1000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_backups = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_gigabytes = 1000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_groups = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_snapshots = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] quota_volumes = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] rate_limit_burst = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] rate_limit_except_level = CRITICAL {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] rate_limit_interval = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] reinit_driver_count = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] replication_device = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] report_discard_supported = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] report_interval = 120 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] reservation_clean_interval = 86400 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] reservation_expire = 86400 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] reserved_image_namespaces = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] reserved_percentage = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] rpc_response_timeout = 120 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] run_external_periodic_tasks = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] scst_target_driver = iscsi {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] scst_target_iqn_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_down_time = 720 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] shell_completion = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] snapshot_name_template = snapshot-%s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] split_loggers = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] state_path = /opt/stack/data/cinder {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] storage_availability_zone = nova {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] storage_protocol = iSCSI {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] syslog_log_facility = LOG_USER {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_helper = lioadm {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_ip_address = 192.168.122.74 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_port = 3260 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_protocol = iscsi {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] target_secondary_ip_addresses = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85963) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] trace_flags = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] transport_url = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] until_refresh = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_chap_auth = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_default_quota_class = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_journal = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_json = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_multipath_for_image_xfer = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_stderr = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] use_syslog = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] verify_glance_signatures = enabled {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_api_class = cinder.volume.api.API {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_backend_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_clear = zero {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_clear_ionice = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_clear_size = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_copy_bps_limit = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_dd_blocksize = 1M {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_name_template = volume-%s {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_service_inithost_offload = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volume_usage_audit_period = month {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] zoning_mode = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_concurrency.disable_process_locking = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.auth_section = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.auth_type = password {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.auth_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.cache = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.include_service_catalog = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.interface = public {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcache_username = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.region_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.service_type = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.backend = dogpile.cache.null {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.backend_argument = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.backend_expiration_time = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.config_prefix = cache.oslo {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.debug_cache_backend = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.enable_retry_client = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.enable_socket_keepalive = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.expiration_time = 600 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.hashclient_retry_attempts = 2 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_dead_retry = 300 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_pool_maxsize = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_sasl_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.proxies = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.redis_db = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.redis_server = localhost:6379 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.retry_attempts = 2 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.retry_delay = 0.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.socket_keepalive_count = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.socket_keepalive_idle = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.socket_keepalive_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.socket_timeout = 1.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.tls_allowed_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.tls_cafile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.tls_certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.tls_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.tls_keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cache.username = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] coordination.backend_url = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.asyncio_connection = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.asyncio_slave_connection = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.backend = sqlalchemy {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.connection = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.connection_debug = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.connection_parameters = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.connection_recycle_time = 3600 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.connection_trace = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.db_inc_retry_interval = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.db_max_retries = 20 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.db_max_retry_interval = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.db_retry_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.max_overflow = 50 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.max_pool_size = 5 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.max_retries = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.mysql_wsrep_sync_wait = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.pool_timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.retry_interval = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.slave_connection = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.sqlite_synchronous = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.synchronous_reader = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] database.use_db_reconnect = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_tracing.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.connection_string = messaging:// {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.es_doc_type = notification {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.es_scroll_size = 10000 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.es_scroll_time = 2m {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.filter_error_trace = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.hmac_keys = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.sentinel_service_name = mymaster {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.socket_timeout = 0.1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.trace_requests = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler.trace_sqlalchemy = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler_jaeger.process_tags = {} {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler_jaeger.service_name_prefix = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] profiler_otlp.service_name_prefix = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.enforce_new_defaults = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.policy_default_rule = default {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.policy_file = policy.yaml {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.group = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.helper_command = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] privsep_osbrick.user = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.group = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.helper_command = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] cinder_sys_admin.user = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.auth_section = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.auth_type = password {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.cafile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.collect_timing = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.send_service_user_token = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.split_loggers = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.tls_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] service_user.tls_min_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.auth_section = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.auth_type = password {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.collect_timing = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.region_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.split_loggers = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.tls_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] glance.tls_min_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.backend_availability_zone = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.chap_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.chap_username = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.disk_geometry = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_client_cert = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_client_cert_key = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_data_namespace = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.driver_use_ssl = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.extra_capabilities = {} {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.filter_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.goodness_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iscsi_target_flags = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iscsi_write_cache = on {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iser_helper = tgtadm {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iser_port = 3260 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_host = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_login = admin {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_mount_options = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_private_key = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_share_path = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.num_shell_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.quobyte_volume_url = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.replication_device = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.report_discard_supported = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.reserved_percentage = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_helper = tgtadm {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_port = 3260 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_protocol = iscsi {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.trace_flags = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.unique_fqdn_network = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.use_chap_auth = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_backend_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_clear = zero {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_clear_ionice = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_clear_size = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_reports.file_event_handler = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_reports.log_dir = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.backend_availability_zone = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.backend_host = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.chap_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.chap_username = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.chiscsi_conf = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.disk_geometry = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_client_cert = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_data_namespace = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.driver_use_ssl = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.extra_capabilities = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.filter_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.goodness_function = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iser_helper = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iser_ip_address = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iser_port = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.iser_target_prefix = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_host = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_login = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_mount_options = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_password = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_private_key = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_share_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_ssh_port = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.num_shell_tries = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.nvmet_port_id = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.replication_device = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.report_discard_supported = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.reserved_percentage = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.scst_target_driver = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.storage_protocol = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_helper = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_ip_address = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_port = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_prefix = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_protocol = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.trace_flags = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.use_chap_auth = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_clear = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_clear_size = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] QuobyteHD.volumes_dir = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85963) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 17 14:56:04 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Running cmd (subprocess): mount.quobyte {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_notifications.driver = [] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_notifications.retry = -1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] key_manager.fixed_key = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.barbican_api_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.barbican_endpoint = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.barbican_endpoint_type = public {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.barbican_region_name = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.cafile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.collect_timing = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.number_of_retries = 60 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.retry_delay = 1 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.send_service_user_token = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.split_loggers = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.tls_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.tls_min_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.verify_ssl = True {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican.verify_ssl_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.auth_section = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.auth_type = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.cafile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.certfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.collect_timing = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.insecure = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.keyfile = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.split_loggers = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.timeout = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.tls_ciphers = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] barbican_service_user.tls_min_version = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.approle_role_id = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.approle_secret_id = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.auth_method = approle {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.auth_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.kv_mountpoint = secret {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.kv_path = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.kv_version = 2 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.namespace = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.root_token_id = **** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.ssl_ca_crt_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.timeout = 60.0 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.token_file = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.token_role = None {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.use_ssl = False {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 17 14:56:04 devstack cinder-volume[85666]: DEBUG oslo_service.backend._eventlet.service [None req-eef6ff6b-8a08-4801-8250-be59a6143a99 None None] ******************************************************************************** {{(pid=85666) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 17 14:56:04 devstack quobyte-client[85972]: Reading configuration file: /etc/quobyte/client.cfg Sep 17 14:56:04 devstack quobyte-client[85972]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:56:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:56:04 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:56:04 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:56:05 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.230s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.volume.driver [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Driver hasn't implemented _init_vendor_properties() Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.driver [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_db.sqlalchemy.engines [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85963) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writer thread running {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.db.api [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Building query based on filter {{(pid=85963) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85963) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.keymgr.migration [None req-f43a1903-c51c-47f7-a6eb-61ce0a46df45 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 17 14:56:05 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:56:05 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:56:05 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.234s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Driver initialization completed successfully. Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Initiating service 3 cleanup Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Service 3 cleanup completed. Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.service [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Creating RPC server for service cinder-volume {{(pid=85963) start /opt/stack/cinder/cinder/service.py:231}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.service [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85963) start /opt/stack/cinder/cinder/service.py:237}} Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:56:05 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:56:05 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:56:05 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Sep 17 14:56:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:56:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0db8983-4176-4c73-8a3f-6912e9bbefb7 None None] Driver post RPC initialization completed successfully. Sep 17 14:56:14 devstack cinder-volume[85666]: DEBUG dbcounter [-] [85666] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85666) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:56:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:56:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:56:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 6 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:56:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Flow 'volume_create_manager' (dfa00f86-6529-41f1-a327-1fae187b7bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103c68d3-b689-442b-97cc-0b25a41469d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103c68d3-b689-442b-97cc-0b25a41469d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-494961310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19ba198-d4c0-49c6-ad10-3330179616fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ec09003b8433e9cb8d383b8102b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:04Z,use_quota=True,user_id='1a6750e6f0d24684b4fc0ca4c15eeb85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99413e-6516-4a0b-b055-ab0cf6ca26b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a99413e-6516-4a0b-b055-ab0cf6ca26b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0917ba-b0f6-4208-821d-548c9a71dc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0917ba-b0f6-4208-821d-548c9a71dc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19ba198-d4c0-49c6-ad10-3330179616fa', 'volume_name': 'volume-d19ba198-d4c0-49c6-ad10-3330179616fa', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b72b97-3fc5-49af-8db1-8bf06d50d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b72b97-3fc5-49af-8db1-8bf06d50d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db55b8f-281e-4208-b833-7caf63cc6472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Volume d19ba198-d4c0-49c6-ad10-3330179616fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19ba198-d4c0-49c6-ad10-3330179616fa', 'volume_size': 1} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-494961310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19ba198-d4c0-49c6-ad10-3330179616fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c6ec09003b8433e9cb8d383b8102b3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:04Z,use_quota=True,user_id='1a6750e6f0d24684b4fc0ca4c15eeb85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Creating volume d19ba198-d4c0-49c6-ad10-3330179616fa {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:03 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:57:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:03 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa 1073741824 Sep 17 14:57:03 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:04 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa 1073741824" returned: 0 in 0.697s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:04 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa Sep 17 14:57:04 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:04 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db55b8f-281e-4208-b833-7caf63cc6472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19ba198-d4c0-49c6-ad10-3330179616fa', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23fa1fb-10c4-44bd-a78a-e3b46d58d872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Volume volume-d19ba198-d4c0-49c6-ad10-3330179616fa (d19ba198-d4c0-49c6-ad10-3330179616fa): created successfully Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e23fa1fb-10c4-44bd-a78a-e3b46d58d872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Flow 'volume_create_manager' (dfa00f86-6529-41f1-a327-1fae187b7bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-072d79e7-b0b7-4d56-bad7-d507b17e0dbb tempest-TaggedAttachmentsTest-511106358 None] Created volume successfully. Sep 17 14:57:14 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:57:14 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Flow 'volume_create_manager' (e8ab6c1d-7050-4a36-8e61-9a324d101c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf2fb3c-1b7a-421f-a501-23cd9c1f2710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf2fb3c-1b7a-421f-a501-23cd9c1f2710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1257439466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab337995eb614f47bce15a29bcdb7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:28Z,use_quota=True,user_id='4a4522e1ff6949bd810158ed75bf693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4526b15b-51dd-4708-b3c7-fe847f417f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4526b15b-51dd-4708-b3c7-fe847f417f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dae9e6-ecf9-4096-958c-f2185152a6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dae9e6-ecf9-4096-958c-f2185152a6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4', 'volume_name': 'volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cd2283-3fb8-461a-ad4e-9cedac17abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50cd2283-3fb8-461a-ad4e-9cedac17abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78a39c-d7c6-471b-a1c1-0c083f86f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Volume ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4', 'volume_size': 1} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1257439466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab337995eb614f47bce15a29bcdb7dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:28Z,use_quota=True,user_id='4a4522e1ff6949bd810158ed75bf693b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Creating volume ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:57:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:27 devstack sudo[86918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 1073741824 Sep 17 14:57:27 devstack sudo[86918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:29 devstack sudo[86918]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 1073741824" returned: 0 in 1.563s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:29 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 Sep 17 14:57:29 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:30 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" returned: 0 in 0.475s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] <== create_volume: return (2264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a78a39c-d7c6-471b-a1c1-0c083f86f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab085c15-1d7b-4534-8e83-a47edb043dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Volume volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 (ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4): created successfully Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab085c15-1d7b-4534-8e83-a47edb043dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Flow 'volume_create_manager' (e8ab6c1d-7050-4a36-8e61-9a324d101c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8d85596f-1091-4071-a6f3-308c34c77a17 tempest-DeleteServersTestJSON-812281977 None] Created volume successfully. Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Flow 'volume_create_manager' (659ee1e7-df97-4c9d-9b65-aed7a6234bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55ac75d-09c4-49bb-982c-b7ceed8e08c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55ac75d-09c4-49bb-982c-b7ceed8e08c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1638728870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397651c-8346-439b-83ea-4e0caac537f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aa01132814acea0105d769d746283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:36Z,use_quota=True,user_id='9bd73774fb7841c0b8aae1db7e067ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7931677-996e-4a59-ba38-368a3ed735cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7931677-996e-4a59-ba38-368a3ed735cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b56a67-aecb-4045-ae9f-1a6ff9920d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b56a67-aecb-4045-ae9f-1a6ff9920d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8397651c-8346-439b-83ea-4e0caac537f3', 'volume_name': 'volume-8397651c-8346-439b-83ea-4e0caac537f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654242bb-37f1-49a5-9de4-eee4742c687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654242bb-37f1-49a5-9de4-eee4742c687b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bade818-fc12-45fb-9b41-494aaa383356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Volume 8397651c-8346-439b-83ea-4e0caac537f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8397651c-8346-439b-83ea-4e0caac537f3', 'volume_size': 1} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1638728870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8397651c-8346-439b-83ea-4e0caac537f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='410aa01132814acea0105d769d746283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:57:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:57:36Z,use_quota=True,user_id='9bd73774fb7841c0b8aae1db7e067ace',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Creating volume 8397651c-8346-439b-83ea-4e0caac537f3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:57:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:57:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:36 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 1073741824 Sep 17 14:57:36 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:37 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 1073741824" returned: 0 in 1.019s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:37 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 Sep 17 14:57:37 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:38 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3" returned: 0 in 0.871s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bade818-fc12-45fb-9b41-494aaa383356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8397651c-8346-439b-83ea-4e0caac537f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9199bb9-eb91-457c-bc1d-70547399576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:57:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Volume volume-8397651c-8346-439b-83ea-4e0caac537f3 (8397651c-8346-439b-83ea-4e0caac537f3): created successfully Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9199bb9-eb91-457c-bc1d-70547399576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:57:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Flow 'volume_create_manager' (659ee1e7-df97-4c9d-9b65-aed7a6234bb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:57:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f48d2e8b-c028-419c-9f2d-0927e4ab441e tempest-VolumesAdminNegativeTest-1403681059 None] Created volume successfully. Sep 17 14:57:39 devstack cinder-volume[85963]: WARNING py.warnings [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 17 14:57:39 devstack cinder-volume[85963]: .first() Sep 17 14:57:39 devstack cinder-volume[85963]: Sep 17 14:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bd56314-b38c-44f3-8268-a85e8805bb78', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:57:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-31262e6c-a2c5-4cc8-b0f3-5ec803dd22ff req-4e10c9f8-093f-4753-ac4b-f4a7126cf0dc tempest-DeleteServersTestJSON-812281977 None] attachment_update completed successfully. Sep 17 14:57:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Acquiring lock "cinder-8397651c-8346-439b-83ea-4e0caac537f3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "cinder-8397651c-8346-439b-83ea-4e0caac537f3-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Acquiring lock "cinder-quobyte-8397651c-8346-439b-83ea-4e0caac537f3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "cinder-quobyte-8397651c-8346-439b-83ea-4e0caac537f3" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:40 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg94gawho/privsep.sock'] Sep 17 14:57:40 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg94gawho/privsep.sock Sep 17 14:57:40 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: Sep 17 14:57:42 devstack cinder-volume[85963]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 17 14:57:43 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:43 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Spawned new privsep daemon via rootwrap Sep 17 14:57:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Accepted privsep connection to /tmp/tmpg94gawho/privsep.sock {{(pid=85963) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 17 14:57:43 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 17 14:57:43 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 17 14:57:43 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 17 14:57:43 devstack cinder-volume[85963]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87605 Sep 17 14:57:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca651e0-f735-4545-955f-33e5ce227f12]: (2,) {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5db1733-bd6e-47e4-a84d-f7b66b2c4f7e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:43 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 Sep 17 14:57:43 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:44 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3" returned: 0 in 0.667s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:44 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3 Sep 17 14:57:44 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:44 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8397651c-8346-439b-83ea-4e0caac537f3" returned: 0 in 0.724s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "cinder-quobyte-8397651c-8346-439b-83ea-4e0caac537f3" released by "delete_volume" :: held 4.028s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:44 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:57:44 devstack cinder-volume[85963]: WARNING cinder.quota [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Created reservations ['2176a330-0401-4dbe-9c35-2bf3995c89b1', '2c8cdf8e-412b-4665-9a48-1b8fc279d99a', 'abe76f71-60c5-4210-9042-c24f6f493ee3', '9b1d116f-0be4-4fd2-9afb-0be9a37a05c0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:45 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:57:45 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:45 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:45 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Deleted volume successfully. Sep 17 14:57:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4ff5f958-1ccf-4673-8626-4e6005242bd0 tempest-VolumesAdminNegativeTest-1403681059 None] Lock "cinder-8397651c-8346-439b-83ea-4e0caac537f3-delete_volume" released by "delete_volume" :: held 5.386s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-215424f0-4a5a-4548-abe0-039fcb0032e3 req-d29c3d1f-730c-4f08-a000-6a9f419933e3 tempest-DeleteServersTestJSON-812281977 None] Terminate volume connection completed successfully. Sep 17 14:57:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-215424f0-4a5a-4548-abe0-039fcb0032e3 req-d29c3d1f-730c-4f08-a000-6a9f419933e3 tempest-DeleteServersTestJSON-812281977 None] Deleting attachment 2bd56314-b38c-44f3-8268-a85e8805bb78. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "cinder-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "cinder-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "cinder-quobyte-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "cinder-quobyte-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a74c86-73d0-4bba-9971-343cdae5c991]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:57:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:50 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 Sep 17 14:57:50 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:51 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:51 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4 Sep 17 14:57:51 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:51 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "cinder-quobyte-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4" released by "delete_volume" :: held 0.823s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Created reservations ['c833c437-f217-473f-9685-2428ae4b8063', '5c010971-ec52-4b42-87ca-e99d2bbf3222', 'c92410b1-c582-42d2-921e-52802be2a528', 'e8d3d37a-0c35-4c99-af7f-01e3d34ea9e1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:51 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:57:51 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:52 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Deleted volume successfully. Sep 17 14:57:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ca895e7-a2b3-4049-a57d-9942af4c98a3 tempest-DeleteServersTestJSON-812281977 None] Lock "cinder-ee8a9c65-c9a0-487a-9af6-cf7cf59c32d4-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:57:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:57:56 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:57:56 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:57:57 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Sep 17 14:57:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:57:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:57:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:57:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 8 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:57:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:58:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=28,cinder:SELECT=16,cinder:DELETE=1,cinder:INSERT=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:02 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=27,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9e9c127b-6fb3-4e84-b9f0-ad92beb80f55 req-e38a74e5-e157-4b32-ae0f-8d1b34aef22b tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9e9c127b-6fb3-4e84-b9f0-ad92beb80f55 req-e38a74e5-e157-4b32-ae0f-8d1b34aef22b tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9e9c127b-6fb3-4e84-b9f0-ad92beb80f55 req-e38a74e5-e157-4b32-ae0f-8d1b34aef22b tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9e9c127b-6fb3-4e84-b9f0-ad92beb80f55 req-e38a74e5-e157-4b32-ae0f-8d1b34aef22b tempest-TaggedAttachmentsTest-511106358 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-d19ba198-d4c0-49c6-ad10-3330179616fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '025d1bbe-5ccf-4347-80f3-e82196ee7bf2', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:58:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-9e9c127b-6fb3-4e84-b9f0-ad92beb80f55 req-e38a74e5-e157-4b32-ae0f-8d1b34aef22b tempest-TaggedAttachmentsTest-511106358 None] attachment_update completed successfully. Sep 17 14:58:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-16f8943a-e05d-4a18-8a08-222852de3151 req-05beb7f5-7955-46e1-adef-354b09c6aa12 tempest-TaggedAttachmentsTest-511106358 None] Terminate volume connection completed successfully. Sep 17 14:58:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-16f8943a-e05d-4a18-8a08-222852de3151 req-05beb7f5-7955-46e1-adef-354b09c6aa12 tempest-TaggedAttachmentsTest-511106358 None] Deleting attachment 025d1bbe-5ccf-4347-80f3-e82196ee7bf2. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:58:26 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:33 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Flow 'volume_create_manager' (fa29748a-4ad2-4c07-81f6-cc6eefbdcfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb901cd-ecb0-4299-9ef1-51fc466577c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb901cd-ecb0-4299-9ef1-51fc466577c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1627505575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaee70f6-75f5-4136-8388-84560108c18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1aa16a5e5f4151abbfac097e7249e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:42Z,use_quota=True,user_id='84dd8ebec34a4856af35ef3540bdfeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21d9669-3373-4a44-9db2-55d1c3a7edc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21d9669-3373-4a44-9db2-55d1c3a7edc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456d7a9-9411-49e5-9e89-640cdde2efa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f456d7a9-9411-49e5-9e89-640cdde2efa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaee70f6-75f5-4136-8388-84560108c18a', 'volume_name': 'volume-aaee70f6-75f5-4136-8388-84560108c18a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa461286-3fa5-4c66-9c4c-1451ee27c56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa461286-3fa5-4c66-9c4c-1451ee27c56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd89e906-7b4d-4191-92cc-d246aac261b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Volume aaee70f6-75f5-4136-8388-84560108c18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaee70f6-75f5-4136-8388-84560108c18a', 'volume_size': 1} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1627505575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaee70f6-75f5-4136-8388-84560108c18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1aa16a5e5f4151abbfac097e7249e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:42Z,use_quota=True,user_id='84dd8ebec34a4856af35ef3540bdfeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Creating volume aaee70f6-75f5-4136-8388-84560108c18a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:41 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:58:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:41 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a 1073741824 Sep 17 14:58:41 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a 1073741824" returned: 0 in 0.725s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:42 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:42 devstack sudo[88666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a Sep 17 14:58:42 devstack sudo[88666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:43 devstack sudo[88666]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd89e906-7b4d-4191-92cc-d246aac261b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaee70f6-75f5-4136-8388-84560108c18a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c5efa8-8c33-4a24-82e3-cae2c6cae88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Volume volume-aaee70f6-75f5-4136-8388-84560108c18a (aaee70f6-75f5-4136-8388-84560108c18a): created successfully Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c5efa8-8c33-4a24-82e3-cae2c6cae88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Flow 'volume_create_manager' (fa29748a-4ad2-4c07-81f6-cc6eefbdcfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a378d5a1-585a-4ee7-989c-7dd1237fa2ed tempest-ServersNegativeTestJSON-471851770 None] Created volume successfully. Sep 17 14:58:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "cinder-d19ba198-d4c0-49c6-ad10-3330179616fa-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "cinder-d19ba198-d4c0-49c6-ad10-3330179616fa-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "cinder-quobyte-d19ba198-d4c0-49c6-ad10-3330179616fa" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "cinder-quobyte-d19ba198-d4c0-49c6-ad10-3330179616fa" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4a522-5486-4de9-8c03-bec7dc228651]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:45 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa Sep 17 14:58:45 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:45 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa" returned: 0 in 0.559s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:45 devstack sudo[88680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa Sep 17 14:58:45 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:46 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d19ba198-d4c0-49c6-ad10-3330179616fa" returned: 0 in 0.535s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "cinder-quobyte-d19ba198-d4c0-49c6-ad10-3330179616fa" released by "delete_volume" :: held 1.198s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Created reservations ['0d7e5d23-8362-4d02-82d7-10d992df87fb', '533b8ee8-65d9-4ae4-b80d-976a21e94938', '694589f1-8fb3-4106-a3c3-cbe55769811f', '9cdae8fa-0bf8-480e-9344-ad593754c279'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:46 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:58:46 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:46 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Deleted volume successfully. Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Flow 'volume_create_manager' (17fba70d-2a1f-426b-8917-5e8db3bc7a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc392b1-f93a-4808-826c-e28142f0528f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc392b1-f93a-4808-826c-e28142f0528f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2093059117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200091d-530c-4254-8a99-cd624181e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1aa16a5e5f4151abbfac097e7249e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:47Z,use_quota=True,user_id='84dd8ebec34a4856af35ef3540bdfeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c5cbf-4f53-4dda-adb0-273cbc345df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649c5cbf-4f53-4dda-adb0-273cbc345df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e0e5f-9cd8-4c0f-b234-cf1fb6c04f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e0e5f-9cd8-4c0f-b234-cf1fb6c04f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5200091d-530c-4254-8a99-cd624181e133', 'volume_name': 'volume-5200091d-530c-4254-8a99-cd624181e133', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2aa9e6-e7ac-4d33-80e9-f03d020372fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2aa9e6-e7ac-4d33-80e9-f03d020372fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92034d80-8d00-41cf-8fe0-dbd22ad76407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Volume 5200091d-530c-4254-8a99-cd624181e133: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5200091d-530c-4254-8a99-cd624181e133', 'volume_size': 1} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2093059117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200091d-530c-4254-8a99-cd624181e133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1aa16a5e5f4151abbfac097e7249e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:58:47Z,use_quota=True,user_id='84dd8ebec34a4856af35ef3540bdfeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Creating volume 5200091d-530c-4254-8a99-cd624181e133 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:58:47 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69ef6f91-fed1-411a-a29c-1fe145675efc tempest-TaggedAttachmentsTest-511106358 None] Lock "cinder-d19ba198-d4c0-49c6-ad10-3330179616fa-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:47 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 1073741824 Sep 17 14:58:47 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:48 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 1073741824" returned: 0 in 0.762s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:48 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 Sep 17 14:58:48 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:48 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133" returned: 0 in 0.462s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92034d80-8d00-41cf-8fe0-dbd22ad76407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5200091d-530c-4254-8a99-cd624181e133', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbebe53-eb71-45f2-b1ed-344d6d5eca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:58:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Volume volume-5200091d-530c-4254-8a99-cd624181e133 (5200091d-530c-4254-8a99-cd624181e133): created successfully Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfbebe53-eb71-45f2-b1ed-344d6d5eca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:58:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Flow 'volume_create_manager' (17fba70d-2a1f-426b-8917-5e8db3bc7a03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:58:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-699a6e85-347d-4782-b3a8-b7940c3c99e9 tempest-ServersNegativeTestJSON-471851770 None] Created volume successfully. Sep 17 14:58:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "cinder-5200091d-530c-4254-8a99-cd624181e133-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-5200091d-530c-4254-8a99-cd624181e133-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "cinder-quobyte-5200091d-530c-4254-8a99-cd624181e133" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-quobyte-5200091d-530c-4254-8a99-cd624181e133" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2033ea43-d3da-4c65-b823-f07f0a7b1226]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:51 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 Sep 17 14:58:51 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:51 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133" returned: 0 in 0.751s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:51 devstack sudo[88751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133 Sep 17 14:58:51 devstack sudo[88751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:52 devstack sudo[88751]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5200091d-530c-4254-8a99-cd624181e133" returned: 0 in 0.758s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-quobyte-5200091d-530c-4254-8a99-cd624181e133" released by "delete_volume" :: held 1.592s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Created reservations ['8e3843fe-d5c1-41a2-ba74-8c3f4176d961', '278523d8-a924-4d67-b85b-97e9cb1c0c85', '4e0367e5-a463-46bc-b567-13ca9c0f118f', '0cda6a24-a7f3-4cea-9dd4-a8295e6c272b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:52 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:58:52 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:53 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Deleted volume successfully. Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-46332640-9b33-4b45-bbaf-5eeead0cfaa3 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-5200091d-530c-4254-8a99-cd624181e133-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "cinder-aaee70f6-75f5-4136-8388-84560108c18a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-aaee70f6-75f5-4136-8388-84560108c18a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "cinder-quobyte-aaee70f6-75f5-4136-8388-84560108c18a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-quobyte-aaee70f6-75f5-4136-8388-84560108c18a" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[517549d3-5c23-4d8f-aafa-7885446ff63c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 14:58:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:54 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a Sep 17 14:58:54 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:54 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a" returned: 0 in 0.764s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:54 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a Sep 17 14:58:54 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:55 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaee70f6-75f5-4136-8388-84560108c18a" returned: 0 in 0.518s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-quobyte-aaee70f6-75f5-4136-8388-84560108c18a" released by "delete_volume" :: held 1.400s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Created reservations ['b932384f-18ad-4fd3-a2e5-5ee0c29a5a1a', '2b76cd30-8413-450b-8f56-6d8e3b8c2fd9', 'dc5bf64b-5808-463a-9741-8bb5ad531e8e', '5b3c6a9c-a0d6-40ee-bbd6-aceb2415c8ff'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:55 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:58:55 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:55 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:58:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Deleted volume successfully. Sep 17 14:58:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fb40edea-777c-4724-9e09-18cc01d3f9e0 tempest-ServersNegativeTestJSON-471851770 None] Lock "cinder-aaee70f6-75f5-4136-8388-84560108c18a-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.071s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:58:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:58:57 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:58:57 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:58:57 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Sep 17 14:58:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.531s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:58:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=17,cinder:UPDATE=31,cinder:INSERT=4,cinder:DELETE=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:05 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=10,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Flow 'volume_create_manager' (461afb9a-a5c6-48eb-a4e6-51b1dedcf4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32326a6d-f583-4744-aff3-7f9f567a208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32326a6d-f583-4744-aff3-7f9f567a208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-773281847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3692c4-368a-42f9-957c-0710416ed476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb798840a8245f9a6a406cbd1689fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:08Z,use_quota=True,user_id='46592ec9b74240c0a4f7695cdc5e2fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd591b-f468-42a3-81d9-e572343426c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abd591b-f468-42a3-81d9-e572343426c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005857eb-4684-4ca2-a49d-2175cf6997d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005857eb-4684-4ca2-a49d-2175cf6997d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3692c4-368a-42f9-957c-0710416ed476', 'volume_name': 'volume-0c3692c4-368a-42f9-957c-0710416ed476', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18553ff0-98bd-4c34-8afd-a4f5cad3cf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18553ff0-98bd-4c34-8afd-a4f5cad3cf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1721b101-7fbb-48b7-8722-c404885932b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:08 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Volume 0c3692c4-368a-42f9-957c-0710416ed476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3692c4-368a-42f9-957c-0710416ed476', 'volume_size': 1} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-773281847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3692c4-368a-42f9-957c-0710416ed476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb798840a8245f9a6a406cbd1689fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:08Z,use_quota=True,user_id='46592ec9b74240c0a4f7695cdc5e2fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Creating volume 0c3692c4-368a-42f9-957c-0710416ed476 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:08 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:08 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 1073741824 Sep 17 14:59:08 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:08 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 1073741824" returned: 0 in 0.632s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:09 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 Sep 17 14:59:09 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:09 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1721b101-7fbb-48b7-8722-c404885932b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3692c4-368a-42f9-957c-0710416ed476', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1332028e-0bbc-4c58-92f5-ed70082a7557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:09 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Volume volume-0c3692c4-368a-42f9-957c-0710416ed476 (0c3692c4-368a-42f9-957c-0710416ed476): created successfully Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1332028e-0bbc-4c58-92f5-ed70082a7557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Flow 'volume_create_manager' (461afb9a-a5c6-48eb-a4e6-51b1dedcf4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a72cd8db-6f7f-4cf3-8fdd-4efd5fd06ebf tempest-ServerActionsTestOtherA-1205983769 None] Created volume successfully. Sep 17 14:59:19 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:19 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (ae2360df-a14b-4dea-8ff8-3c2bd5f3a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ae7728-ce29-48fa-b5f7-9f05194216bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2ae7728-ce29-48fa-b5f7-9f05194216bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-974752799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc58ee0-f4dd-4474-871e-484787e1001f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:21Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954efb44-f7fc-48b9-9211-eb57269a9d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (954efb44-f7fc-48b9-9211-eb57269a9d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069f2f5-e365-4667-8996-54730f6de46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5069f2f5-e365-4667-8996-54730f6de46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc58ee0-f4dd-4474-871e-484787e1001f', 'volume_name': 'volume-8dc58ee0-f4dd-4474-871e-484787e1001f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e97ccb0-ce29-4479-98ef-7d6e3a66bef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e97ccb0-ce29-4479-98ef-7d6e3a66bef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e35bcb-1a88-4a07-a9f6-91433a553e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Volume 8dc58ee0-f4dd-4474-871e-484787e1001f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc58ee0-f4dd-4474-871e-484787e1001f', 'volume_size': 1} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-974752799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc58ee0-f4dd-4474-871e-484787e1001f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:21Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Creating volume 8dc58ee0-f4dd-4474-871e-484787e1001f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:21 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f 1073741824 Sep 17 14:59:21 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:21 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f 1073741824" returned: 0 in 0.580s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:21 devstack sudo[88973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f Sep 17 14:59:21 devstack sudo[88973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:21 devstack sudo[88973]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e35bcb-1a88-4a07-a9f6-91433a553e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc58ee0-f4dd-4474-871e-484787e1001f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7248a5cb-4235-4f34-b0fa-d536477d01cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Volume volume-8dc58ee0-f4dd-4474-871e-484787e1001f (8dc58ee0-f4dd-4474-871e-484787e1001f): created successfully Sep 17 14:59:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7248a5cb-4235-4f34-b0fa-d536477d01cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (ae2360df-a14b-4dea-8ff8-3c2bd5f3a909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7f4ce4e9-6e80-4750-b148-01e871fe2b79 tempest-AttachVolumeNegativeTest-904535147 None] Created volume successfully. Sep 17 14:59:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-27d02e1d-c3d1-4b76-978c-1a39ade35468 req-ab0a2a2b-680b-4df6-9881-4034bfb3520c tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-27d02e1d-c3d1-4b76-978c-1a39ade35468 req-ab0a2a2b-680b-4df6-9881-4034bfb3520c tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-27d02e1d-c3d1-4b76-978c-1a39ade35468 req-ab0a2a2b-680b-4df6-9881-4034bfb3520c tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-27d02e1d-c3d1-4b76-978c-1a39ade35468 req-ab0a2a2b-680b-4df6-9881-4034bfb3520c tempest-AttachVolumeNegativeTest-904535147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-8dc58ee0-f4dd-4474-871e-484787e1001f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e99a279d-16b5-4a9d-89aa-f00419ada5d2', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-27d02e1d-c3d1-4b76-978c-1a39ade35468 req-ab0a2a2b-680b-4df6-9881-4034bfb3520c tempest-AttachVolumeNegativeTest-904535147 None] attachment_update completed successfully. Sep 17 14:59:34 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:34 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 14:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93805255-b364-4353-a602-5eac19ea3da9 req-24b77d77-221e-41d1-b3e6-985a474f47ba tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93805255-b364-4353-a602-5eac19ea3da9 req-24b77d77-221e-41d1-b3e6-985a474f47ba tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-93805255-b364-4353-a602-5eac19ea3da9 req-24b77d77-221e-41d1-b3e6-985a474f47ba tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-93805255-b364-4353-a602-5eac19ea3da9 req-24b77d77-221e-41d1-b3e6-985a474f47ba tempest-ServerActionsTestOtherA-1205983769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-0c3692c4-368a-42f9-957c-0710416ed476', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68b86033-a142-48f1-b163-381bc77dee8f', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-93805255-b364-4353-a602-5eac19ea3da9 req-24b77d77-221e-41d1-b3e6-985a474f47ba tempest-ServerActionsTestOtherA-1205983769 None] attachment_update completed successfully. Sep 17 14:59:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-62eb78da-e819-459d-a1e9-8356ccf45436 tempest-ServerActionsTestOtherA-1205983769 None] Terminate volume connection completed successfully. Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-62eb78da-e819-459d-a1e9-8356ccf45436 tempest-ServerActionsTestOtherA-1205983769 None] Deleting attachment 68b86033-a142-48f1-b163-381bc77dee8f. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:57 devstack sudo[89865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 14:59:57 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:57 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.778s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 14:59:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 14:59:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 8 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 14:59:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-89bd85ae-e409-4cfa-98ab-091fbe8e544d tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-89bd85ae-e409-4cfa-98ab-091fbe8e544d tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-89bd85ae-e409-4cfa-98ab-091fbe8e544d tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-89bd85ae-e409-4cfa-98ab-091fbe8e544d tempest-ServerActionsTestOtherA-1205983769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-0c3692c4-368a-42f9-957c-0710416ed476', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee77b658-c853-49b6-ba0b-268f5aa5cafd', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 14:59:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-ba4c414b-795a-48ec-a402-f5e5a75bd0a4 req-89bd85ae-e409-4cfa-98ab-091fbe8e544d tempest-ServerActionsTestOtherA-1205983769 None] attachment_update completed successfully. Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Flow 'volume_create_manager' (52906827-1236-4996-9aeb-2cd20b5f57eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61450820-0edc-4792-9fe7-1d3efff212cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61450820-0edc-4792-9fe7-1d3efff212cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-742863867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388964cd-11d0-483f-81a2-651125bb1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b188118806d4fd198b211e8df1f8d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:59Z,use_quota=True,user_id='b3e3845e5da64f33825a04f5ac48db73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d3759-8fb1-4b1c-92de-be8402e1d39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3d3759-8fb1-4b1c-92de-be8402e1d39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646cb04c-de85-4574-b4bc-c546728b0004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (646cb04c-de85-4574-b4bc-c546728b0004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '388964cd-11d0-483f-81a2-651125bb1e6b', 'volume_name': 'volume-388964cd-11d0-483f-81a2-651125bb1e6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfbdd46-ebb8-4767-bd18-8541232297c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdfbdd46-ebb8-4767-bd18-8541232297c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd36550b-905c-413b-a52b-a3e6fdb259c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Volume 388964cd-11d0-483f-81a2-651125bb1e6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-388964cd-11d0-483f-81a2-651125bb1e6b', 'volume_size': 1} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T12:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-742863867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=388964cd-11d0-483f-81a2-651125bb1e6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b188118806d4fd198b211e8df1f8d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T12:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T12:59:59Z,use_quota=True,user_id='b3e3845e5da64f33825a04f5ac48db73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Creating volume 388964cd-11d0-483f-81a2-651125bb1e6b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 14:59:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 14:59:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:58 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b 1073741824 Sep 17 14:59:58 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:59 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b 1073741824" returned: 0 in 0.591s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 14:59:59 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b Sep 17 14:59:59 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 14:59:59 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd36550b-905c-413b-a52b-a3e6fdb259c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-388964cd-11d0-483f-81a2-651125bb1e6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469b02c9-9c35-41f0-9562-0f1d648bc8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 14:59:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Volume volume-388964cd-11d0-483f-81a2-651125bb1e6b (388964cd-11d0-483f-81a2-651125bb1e6b): created successfully Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (469b02c9-9c35-41f0-9562-0f1d648bc8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 14:59:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Flow 'volume_create_manager' (52906827-1236-4996-9aeb-2cd20b5f57eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 14:59:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d0650f3c-307d-40f4-9de2-513b71e5660a tempest-AttachVolumeShelveTestJSON-1932959403 None] Created volume successfully. Sep 17 15:00:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-7e7ef2a1-abc6-466d-a67b-07533d78ae9e req-412950e7-5f68-43b9-a403-5a39692af442 tempest-AttachVolumeShelveTestJSON-1932959403 None] No connector for attachment a872318b-f00f-4c3f-b47f-fdf5f0bdbfab; skipping storage backend terminate_connection call. {{(pid=85963) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 17 15:00:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-7e7ef2a1-abc6-466d-a67b-07533d78ae9e req-412950e7-5f68-43b9-a403-5a39692af442 tempest-AttachVolumeShelveTestJSON-1932959403 None] Deleting attachment a872318b-f00f-4c3f-b47f-fdf5f0bdbfab. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:00:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (9b474e1d-1e99-494e-a396-ce8790e080f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c8b8f2-a03a-4541-987d-464ab4abebd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c8b8f2-a03a-4541-987d-464ab4abebd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528665019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa56c128-e7af-463f-afed-10136a5f171b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:17Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a9b857-72c9-4056-8bc1-4915231b4170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a9b857-72c9-4056-8bc1-4915231b4170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353a6f9-84c1-441c-ba75-3262b31b09ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353a6f9-84c1-441c-ba75-3262b31b09ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa56c128-e7af-463f-afed-10136a5f171b', 'volume_name': 'volume-aa56c128-e7af-463f-afed-10136a5f171b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6edfd7-6356-4e57-8433-b7e68d06c728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6edfd7-6356-4e57-8433-b7e68d06c728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34582a65-74a9-4c9c-9aec-5f4061cfabdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Volume aa56c128-e7af-463f-afed-10136a5f171b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa56c128-e7af-463f-afed-10136a5f171b', 'volume_size': 1} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1528665019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa56c128-e7af-463f-afed-10136a5f171b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:17Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Creating volume aa56c128-e7af-463f-afed-10136a5f171b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:17 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:00:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:17 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b 1073741824 Sep 17 15:00:17 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:18 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b 1073741824" returned: 0 in 0.678s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:18 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b Sep 17 15:00:18 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:18 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34582a65-74a9-4c9c-9aec-5f4061cfabdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa56c128-e7af-463f-afed-10136a5f171b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca746e61-0b43-4971-97f0-c776c6404d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Volume volume-aa56c128-e7af-463f-afed-10136a5f171b (aa56c128-e7af-463f-afed-10136a5f171b): created successfully Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca746e61-0b43-4971-97f0-c776c6404d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (9b474e1d-1e99-494e-a396-ce8790e080f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9275c0e2-1615-4933-8771-cfba7faff079 tempest-AttachVolumeTestJSON-496948220 None] Created volume successfully. Sep 17 15:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df31cbb8-aaec-40d6-9648-0141787cf3fa req-f03c7dd3-ad2e-42ff-8670-3e55d3f1a397 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df31cbb8-aaec-40d6-9648-0141787cf3fa req-f03c7dd3-ad2e-42ff-8670-3e55d3f1a397 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df31cbb8-aaec-40d6-9648-0141787cf3fa req-f03c7dd3-ad2e-42ff-8670-3e55d3f1a397 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-df31cbb8-aaec-40d6-9648-0141787cf3fa req-f03c7dd3-ad2e-42ff-8670-3e55d3f1a397 tempest-AttachVolumeTestJSON-496948220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-aa56c128-e7af-463f-afed-10136a5f171b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0808cb72-ab3a-4535-910c-83f5c9e0e5d5', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:00:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-df31cbb8-aaec-40d6-9648-0141787cf3fa req-f03c7dd3-ad2e-42ff-8670-3e55d3f1a397 tempest-AttachVolumeTestJSON-496948220 None] attachment_update completed successfully. Sep 17 15:00:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-53bdaf58-65a7-4c9b-8be4-c50d42b52d47 req-deb301b7-cb78-4a69-a6f9-99f0920721dc tempest-AttachVolumeNegativeTest-904535147 None] Terminate volume connection completed successfully. Sep 17 15:00:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-53bdaf58-65a7-4c9b-8be4-c50d42b52d47 req-deb301b7-cb78-4a69-a6f9-99f0920721dc tempest-AttachVolumeNegativeTest-904535147 None] Deleting attachment e99a279d-16b5-4a9d-89aa-f00419ada5d2. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:00:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-146b5c99-041a-4484-9e72-0d3d7f727a94 req-35e0bf63-a38a-490e-9b6c-2f6920187014 tempest-ServerActionsTestOtherA-1205983769 None] Terminate volume connection completed successfully. Sep 17 15:00:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-146b5c99-041a-4484-9e72-0d3d7f727a94 req-35e0bf63-a38a-490e-9b6c-2f6920187014 tempest-ServerActionsTestOtherA-1205983769 None] Deleting attachment ee77b658-c853-49b6-ba0b-268f5aa5cafd. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=32,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Flow 'volume_create_manager' (101b71d3-ea43-44bd-8657-7c4383540437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc204650-3f99-4ce4-8a99-b83f8894d278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc204650-3f99-4ce4-8a99-b83f8894d278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1158788485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7f3d19-5225-43c0-be99-71897d3e0044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb798840a8245f9a6a406cbd1689fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:40Z,use_quota=True,user_id='46592ec9b74240c0a4f7695cdc5e2fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac95d30-40fc-46ce-af1e-39939addd560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac95d30-40fc-46ce-af1e-39939addd560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5f4de6-cb23-4b0f-bab3-cf93a42f93f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:40 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd5f4de6-cb23-4b0f-bab3-cf93a42f93f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1b7f3d19-5225-43c0-be99-71897d3e0044', 'volume_name': 'volume-1b7f3d19-5225-43c0-be99-71897d3e0044', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e7628e-f952-4aa0-8e26-28858bbb60a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e7628e-f952-4aa0-8e26-28858bbb60a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6d2f21-5b7a-44be-9a40-f4417d317928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Volume 1b7f3d19-5225-43c0-be99-71897d3e0044: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1b7f3d19-5225-43c0-be99-71897d3e0044', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Trying to clone 1b7f3d19-5225-43c0-be99-71897d3e0044 from image 8d02878c-b12d-4421-bc53-544f1bf812dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:00:41 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ec2881-91e4-4058-8d4a-185de40628c8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:42 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD Sep 17 15:00:42 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:42 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD" returned: 0 in 0.662s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:42 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd is fetched for user 46592ec9b74240c0a4f7695cdc5e2fef. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:00:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3b66eb-67e1-4ef9-b8b1-4a765d13a04a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:42 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD Sep 17 15:00:42 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:43 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1158788485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7f3d19-5225-43c0-be99-71897d3e0044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6eb798840a8245f9a6a406cbd1689fca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:00:40Z,use_quota=True,user_id='46592ec9b74240c0a4f7695cdc5e2fef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Creating volume 1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:00:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:43 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1073741824 Sep 17 15:00:43 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:43 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1073741824" returned: 0 in 0.622s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:43 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 Sep 17 15:00:43 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:44 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Attempting download of 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 1b7f3d19-5225-43c0-be99-71897d3e0044. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9552dec-6f50-4044-8a70-5fe8ab3f5f10]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:44 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0 Sep 17 15:00:44 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:44 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:44 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0 Sep 17 15:00:44 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:45 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0" returned: 1 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_bj7ihjt0' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7977c79-2802-4c60-8079-84056bcb6889]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:45 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD Sep 17 15:00:45 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:45 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] 8d02878c-b12d-4421-bc53-544f1bf812dd was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:00:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:45 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 Sep 17 15:00:45 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:47 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044" returned: 0 in 2.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:47 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_oav9mbwadevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:00:47 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Converted 112.00 MB image at 48.38 MB/s Sep 17 15:00:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:47 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1G Sep 17 15:00:47 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:48 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 1G" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Downloaded image 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 1b7f3d19-5225-43c0-be99-71897d3e0044 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd for user 46592ec9b74240c0a4f7695cdc5e2fef is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Marking volume 1b7f3d19-5225-43c0-be99-71897d3e0044 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Copying metadata from image 8d02878c-b12d-4421-bc53-544f1bf812dd to 1b7f3d19-5225-43c0-be99-71897d3e0044. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Creating volume glance metadata for volume 1b7f3d19-5225-43c0-be99-71897d3e0044 backed by image 8d02878c-b12d-4421-bc53-544f1bf812dd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6d2f21-5b7a-44be-9a40-f4417d317928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7f3d19-5225-43c0-be99-71897d3e0044', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6611035-71c0-4637-8284-1f857da5b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:00:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Volume volume-1b7f3d19-5225-43c0-be99-71897d3e0044 (1b7f3d19-5225-43c0-be99-71897d3e0044): created successfully Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6611035-71c0-4637-8284-1f857da5b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:00:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Flow 'volume_create_manager' (101b71d3-ea43-44bd-8657-7c4383540437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:00:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-434cd11a-72df-4092-be36-9ba934d969f8 tempest-ServerActionsTestOtherA-1205983769 None] Created volume successfully. Sep 17 15:00:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-116204d8-14cc-4794-8088-a369f9635cf8 req-8c97f4e2-bbcd-41a0-8d7f-f13e2985e66c tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-116204d8-14cc-4794-8088-a369f9635cf8 req-8c97f4e2-bbcd-41a0-8d7f-f13e2985e66c tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-116204d8-14cc-4794-8088-a369f9635cf8 req-8c97f4e2-bbcd-41a0-8d7f-f13e2985e66c tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-116204d8-14cc-4794-8088-a369f9635cf8 req-8c97f4e2-bbcd-41a0-8d7f-f13e2985e66c tempest-ServerActionsTestOtherA-1205983769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-1b7f3d19-5225-43c0-be99-71897d3e0044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f5abc52-8b78-40fb-b09d-b4c5bcdd31e5', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:00:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-116204d8-14cc-4794-8088-a369f9635cf8 req-8c97f4e2-bbcd-41a0-8d7f-f13e2985e66c tempest-ServerActionsTestOtherA-1205983769 None] attachment_update completed successfully. Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:00:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:00:56 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:00:56 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:00:57 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Sep 17 15:00:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:00:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:00:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:00:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:01:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=7,cinder:SELECT=11,cinder:INSERT=9 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:01 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-1d1f13a1-2620-436f-89e9-9a348ef7b137 tempest-ServerActionsTestOtherA-1205983769 None] Terminate volume connection completed successfully. Sep 17 15:01:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-1d1f13a1-2620-436f-89e9-9a348ef7b137 tempest-ServerActionsTestOtherA-1205983769 None] Deleting attachment 2f5abc52-8b78-40fb-b09d-b4c5bcdd31e5. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-66d57117-558c-4fb8-8bea-ac4474d9bcba tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-66d57117-558c-4fb8-8bea-ac4474d9bcba tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-66d57117-558c-4fb8-8bea-ac4474d9bcba tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-66d57117-558c-4fb8-8bea-ac4474d9bcba tempest-ServerActionsTestOtherA-1205983769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-1b7f3d19-5225-43c0-be99-71897d3e0044', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1aa881ec-6e50-4ad1-bb1b-9f71dc1deaca', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:01:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-34297251-e068-4b14-9fb7-0ebb4515aefb req-66d57117-558c-4fb8-8bea-ac4474d9bcba tempest-ServerActionsTestOtherA-1205983769 None] attachment_update completed successfully. Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (14619fb2-b24f-4c41-b958-facaa9ad1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b92a8-4a66-4ed2-bbae-46de28a27cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1b92a8-4a66-4ed2-bbae-46de28a27cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-146512154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc761779-1051-41f1-8ff2-2e713386c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:07Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df4c85-d97b-4898-9b0c-53c1603733bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72df4c85-d97b-4898-9b0c-53c1603733bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0adb7c-8e09-4951-bb8c-fa040311fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f0adb7c-8e09-4951-bb8c-fa040311fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc761779-1051-41f1-8ff2-2e713386c34a', 'volume_name': 'volume-dc761779-1051-41f1-8ff2-2e713386c34a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd60244-b38e-4f10-bd2c-8fdf904bbe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd60244-b38e-4f10-bd2c-8fdf904bbe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8308e2f-2585-410f-9ee2-0372fd2cff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Volume dc761779-1051-41f1-8ff2-2e713386c34a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc761779-1051-41f1-8ff2-2e713386c34a', 'volume_size': 1} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-146512154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc761779-1051-41f1-8ff2-2e713386c34a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:07Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Creating volume dc761779-1051-41f1-8ff2-2e713386c34a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:07 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:07 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a 1073741824 Sep 17 15:01:07 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:08 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a 1073741824" returned: 0 in 0.774s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:08 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a Sep 17 15:01:08 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:08 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8308e2f-2585-410f-9ee2-0372fd2cff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc761779-1051-41f1-8ff2-2e713386c34a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bf7943-0503-41e0-8818-adc967aac692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:08 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Volume volume-dc761779-1051-41f1-8ff2-2e713386c34a (dc761779-1051-41f1-8ff2-2e713386c34a): created successfully Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bf7943-0503-41e0-8818-adc967aac692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (14619fb2-b24f-4c41-b958-facaa9ad1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fd2e2001-f0ee-4c45-b639-c4dd057fcf82 tempest-AttachVolumeNegativeTest-904535147 None] Created volume successfully. Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Acquiring lock "cinder-388964cd-11d0-483f-81a2-651125bb1e6b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "cinder-388964cd-11d0-483f-81a2-651125bb1e6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c684c0da-a1fb-4327-9373-1409c65c8227 req-12523b52-eed7-43eb-8be3-77d059906ebe tempest-AttachVolumeTestJSON-496948220 None] Terminate volume connection completed successfully. Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c684c0da-a1fb-4327-9373-1409c65c8227 req-12523b52-eed7-43eb-8be3-77d059906ebe tempest-AttachVolumeTestJSON-496948220 None] Deleting attachment 0808cb72-ab3a-4535-910c-83f5c9e0e5d5. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Acquiring lock "cinder-quobyte-388964cd-11d0-483f-81a2-651125bb1e6b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "cinder-quobyte-388964cd-11d0-483f-81a2-651125bb1e6b" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ec0877-d91e-4ba1-8984-18959f23f981]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:09 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b Sep 17 15:01:09 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:10 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b" returned: 0 in 0.749s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:10 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b Sep 17 15:01:10 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:10 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-388964cd-11d0-483f-81a2-651125bb1e6b" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "cinder-quobyte-388964cd-11d0-483f-81a2-651125bb1e6b" released by "delete_volume" :: held 1.264s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Created reservations ['0f5862e8-1e0d-4bd7-b963-237bfde47e64', 'ebc1817e-e34c-452a-8d67-37cfbe371319', '14a31909-3e89-4db0-a39a-91716b3d5bde', '3be97f99-2a4d-4ec9-bf76-e1bfb10e3aa5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-217b4337-10e4-4c8f-83f4-d683c5d35d8f req-59096d03-ccff-4be8-be0d-c6adff926345 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-217b4337-10e4-4c8f-83f4-d683c5d35d8f req-59096d03-ccff-4be8-be0d-c6adff926345 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-217b4337-10e4-4c8f-83f4-d683c5d35d8f req-59096d03-ccff-4be8-be0d-c6adff926345 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-217b4337-10e4-4c8f-83f4-d683c5d35d8f req-59096d03-ccff-4be8-be0d-c6adff926345 tempest-AttachVolumeNegativeTest-904535147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-dc761779-1051-41f1-8ff2-2e713386c34a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '551e9fc9-38c4-4194-9d82-ad7f0b3a7be8', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:01:11 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:11 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-217b4337-10e4-4c8f-83f4-d683c5d35d8f req-59096d03-ccff-4be8-be0d-c6adff926345 tempest-AttachVolumeNegativeTest-904535147 None] attachment_update completed successfully. Sep 17 15:01:11 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Deleted volume successfully. Sep 17 15:01:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b35b2f5d-e6e2-43fb-bda8-75d808ba1e02 tempest-AttachVolumeShelveTestJSON-1932959403 None] Lock "cinder-388964cd-11d0-483f-81a2-651125bb1e6b-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-1636a19f-d26b-4b8f-8c94-4784b0648a1f req-ae934811-ec2a-4598-8c08-8f74099058c6 tempest-AttachVolumeNegativeTest-904535147 None] Terminate volume connection completed successfully. Sep 17 15:01:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-1636a19f-d26b-4b8f-8c94-4784b0648a1f req-ae934811-ec2a-4598-8c08-8f74099058c6 tempest-AttachVolumeNegativeTest-904535147 None] Deleting attachment 551e9fc9-38c4-4194-9d82-ad7f0b3a7be8. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:01:24 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=21,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:24 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=25,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Flow 'volume_create_manager' (33674dd4-328a-4636-965d-298468a71127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234dd4d-506b-49ac-8d01-4e24f02a983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7234dd4d-506b-49ac-8d01-4e24f02a983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-100477950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc47896-ec8f-4eca-9764-908039fba02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f4520ffa5b42fe8ed5d8b91d0f90e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:26Z,use_quota=True,user_id='3e2776c2e9534595889ea65229a5d65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cac28-1ba5-400e-a94d-cebba1456136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358cac28-1ba5-400e-a94d-cebba1456136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485fe176-2f43-409f-9e08-178866a98124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485fe176-2f43-409f-9e08-178866a98124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc47896-ec8f-4eca-9764-908039fba02c', 'volume_name': 'volume-6dc47896-ec8f-4eca-9764-908039fba02c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1523d68c-ed91-44e1-bdf4-5ab32c0ebd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1523d68c-ed91-44e1-bdf4-5ab32c0ebd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f9ef14-50d9-430b-9988-8ddd9abd2965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Volume 6dc47896-ec8f-4eca-9764-908039fba02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc47896-ec8f-4eca-9764-908039fba02c', 'volume_size': 1} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-100477950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc47896-ec8f-4eca-9764-908039fba02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f4520ffa5b42fe8ed5d8b91d0f90e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:26Z,use_quota=True,user_id='3e2776c2e9534595889ea65229a5d65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Creating volume 6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:26 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c 1073741824 Sep 17 15:01:26 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:26 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c 1073741824" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:26 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c Sep 17 15:01:26 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:27 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4f9ef14-50d9-430b-9988-8ddd9abd2965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc47896-ec8f-4eca-9764-908039fba02c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78a8287-5462-4240-a858-dc9cb9cb759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Volume volume-6dc47896-ec8f-4eca-9764-908039fba02c (6dc47896-ec8f-4eca-9764-908039fba02c): created successfully Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e78a8287-5462-4240-a858-dc9cb9cb759b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Flow 'volume_create_manager' (33674dd4-328a-4636-965d-298468a71127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-3624eb1f-ee0f-42ac-b76e-5cbb522cb94e req-583259fb-1500-4bca-8101-8a2d09032605 tempest-VolumesSnapshotsTestJSON-1934631526 None] Created volume successfully. Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Creating offline snapshot aa9dc07a-540d-4c9b-8949-e2d45151939e of volume 6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:01:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6eded1-e346-4555-b42f-798ea0eb35c0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:28 devstack sudo[91077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c Sep 17 15:01:28 devstack sudo[91077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:28 devstack sudo[91077]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c" returned: 0 in 0.689s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:28 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e 1G Sep 17 15:01:28 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:29 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e 1G" returned: 0 in 0.623s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc47896-ec8f-4eca-9764-908039fba02c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:29 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc47896-ec8f-4eca-9764-908039fba02c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e Sep 17 15:01:29 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:29 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc47896-ec8f-4eca-9764-908039fba02c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e" returned: 0 in 0.588s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:29 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e is being set with open permissions: ugo+rw Sep 17 15:01:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:30 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e Sep 17 15:01:30 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:30 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:30 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info Sep 17 15:01:30 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:30 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info" returned: 0 in 0.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:30 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info is being set with open permissions: ugo+rw Sep 17 15:01:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:30 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info Sep 17 15:01:30 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:31 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.info" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.220s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-96e1b061-2ebc-42a0-94a6-8d051275cb20 req-000cc9be-de6b-4095-9770-672b6ff73dfc tempest-VolumesSnapshotsTestJSON-1934631526 None] Create snapshot completed successfully Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "cinder-aa9dc07a-540d-4c9b-8949-e2d45151939e-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-aa9dc07a-540d-4c9b-8949-e2d45151939e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "cinder-quobyte-aa9dc07a-540d-4c9b-8949-e2d45151939e" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-aa9dc07a-540d-4c9b-8949-e2d45151939e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Deleting offline snapshot aa9dc07a-540d-4c9b-8949-e2d45151939e of volume 6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] snapshot_file for this snap is: volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e34d435-054b-4874-891f-bc8b02007381]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:32 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e Sep 17 15:01:32 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:32 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc47896-ec8f-4eca-9764-908039fba02c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ee8a3a-5618-47ef-8e6b-31058fef10a6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:32 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c Sep 17 15:01:32 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:33 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:33 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e Sep 17 15:01:33 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:33 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e" returned: 0 in 0.594s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:33 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e Sep 17 15:01:33 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:34 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c.aa9dc07a-540d-4c9b-8949-e2d45151939e" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-aa9dc07a-540d-4c9b-8949-e2d45151939e" released by "_delete_snapshot" :: held 2.094s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" released by "delete_snapshot" :: held 2.121s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:34 devstack cinder-volume[85963]: WARNING cinder.quota [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.quota [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Created reservations ['82568c8a-cebb-4e75-9718-49571e2a37b9', '7f746494-1fc4-467d-b336-86d9f4bf4930', 'f424b5c6-4a54-4c76-91a5-f434bd98f71d', '76092cad-5415-459f-8adc-1701143c5a85'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Delete snapshot completed successfully. Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-ada7f2f4-430f-46d0-b600-f2f48eaf338f req-2ae119ba-0a75-45d3-99bb-cd00bdb6531e tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-aa9dc07a-540d-4c9b-8949-e2d45151939e-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "cinder-6dc47896-ec8f-4eca-9764-908039fba02c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-6dc47896-ec8f-4eca-9764-908039fba02c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92c6f66-6643-4e59-abc9-ddb4bd86a792]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:34 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c Sep 17 15:01:34 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:35 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:35 devstack sudo[91259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c Sep 17 15:01:35 devstack sudo[91259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:35 devstack sudo[91259]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6dc47896-ec8f-4eca-9764-908039fba02c" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-quobyte-6dc47896-ec8f-4eca-9764-908039fba02c" released by "delete_volume" :: held 0.955s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.quota [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Created reservations ['96b76db4-3746-4c36-9969-63c9b86d48bb', '03ead644-8582-4626-bf45-31a4d27721ef', '8d734808-4d67-4f52-aa35-a5cb9fcb920e', '60d96a8d-0077-4eef-9e97-a3d04cf6c309'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:35 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:35 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:35 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.manager [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Deleted volume successfully. Sep 17 15:01:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-4f68faf7-4664-4549-a6de-a91dda221334 req-72fdca9c-d049-495c-a352-79fb2a2a43e6 tempest-VolumesSnapshotsTestJSON-1934631526 None] Lock "cinder-6dc47896-ec8f-4eca-9764-908039fba02c-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (b97f30c5-ce0f-4b94-b746-e3912bef164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a879aa72-c5c6-4bee-a439-bc83a8554078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a879aa72-c5c6-4bee-a439-bc83a8554078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2064712192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0f5ff1-b005-42ad-927a-4a013e67d4dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:41Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762dfbe4-a47a-47af-b02e-34c3873e0c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762dfbe4-a47a-47af-b02e-34c3873e0c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9e3abc-3b94-40aa-953f-b0764f8eafcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b9e3abc-3b94-40aa-953f-b0764f8eafcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0f5ff1-b005-42ad-927a-4a013e67d4dd', 'volume_name': 'volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2212f79-7c62-4cc0-ac30-b933898e404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2212f79-7c62-4cc0-ac30-b933898e404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d57f314-6fc3-490b-8b23-25f4d80efc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Volume 1c0f5ff1-b005-42ad-927a-4a013e67d4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd', 'volume_size': 1} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2064712192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0f5ff1-b005-42ad-927a-4a013e67d4dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:41Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Creating volume 1c0f5ff1-b005-42ad-927a-4a013e67d4dd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:40 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:40 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd 1073741824 Sep 17 15:01:40 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:41 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd 1073741824" returned: 0 in 0.674s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:41 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd Sep 17 15:01:41 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:41 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d57f314-6fc3-490b-8b23-25f4d80efc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7149e86f-8301-4b76-a4e6-1354569115df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Volume volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd (1c0f5ff1-b005-42ad-927a-4a013e67d4dd): created successfully Sep 17 15:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7149e86f-8301-4b76-a4e6-1354569115df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (b97f30c5-ce0f-4b94-b746-e3912bef164d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a68430c5-54d7-40dc-8c55-71c798d85378 tempest-VolumesTestJSON-864200706 None] Created volume successfully. Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (1ab5029e-d222-4bc3-8f79-4213f71c804d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efad8ea5-537d-4f9c-98ff-68a257afcac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efad8ea5-537d-4f9c-98ff-68a257afcac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1280525900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a6a14-0787-46c6-9f70-cb6e11e27d0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:43Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa5f903-0601-42a7-92ec-e7847369a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa5f903-0601-42a7-92ec-e7847369a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f26bbc6-ad81-432d-8661-4d5905b48352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f26bbc6-ad81-432d-8661-4d5905b48352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '423a6a14-0787-46c6-9f70-cb6e11e27d0e', 'volume_name': 'volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868ff615-030f-4832-84bc-2c1c9855eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868ff615-030f-4832-84bc-2c1c9855eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1ae2c9-292b-4711-bf2b-bce606be0c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Volume 423a6a14-0787-46c6-9f70-cb6e11e27d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e', 'volume_size': 1} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1280525900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=423a6a14-0787-46c6-9f70-cb6e11e27d0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:43Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Creating volume 423a6a14-0787-46c6-9f70-cb6e11e27d0e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:43 devstack sudo[91312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e 1073741824 Sep 17 15:01:43 devstack sudo[91312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:44 devstack sudo[91312]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e 1073741824" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:44 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e Sep 17 15:01:44 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:44 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1ae2c9-292b-4711-bf2b-bce606be0c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca10eb8-12b0-4c2a-ab66-22522abcace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Volume volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e (423a6a14-0787-46c6-9f70-cb6e11e27d0e): created successfully Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca10eb8-12b0-4c2a-ab66-22522abcace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (1ab5029e-d222-4bc3-8f79-4213f71c804d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c32bb607-c2ba-4b8e-b587-16f26a469fbc tempest-VolumesTestJSON-864200706 None] Created volume successfully. Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (ce7fdac2-0a8c-4650-a7af-b18be6ac2efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5ab817-8252-4df4-8578-aac2229b087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff5ab817-8252-4df4-8578-aac2229b087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1735483139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b9b8b0-3307-47ae-991e-e5e5119e4a37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:46Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57af7be-7621-436e-a3ce-bbba27f5bacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57af7be-7621-436e-a3ce-bbba27f5bacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c58dae7-2659-4379-972e-d78382250240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c58dae7-2659-4379-972e-d78382250240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2b9b8b0-3307-47ae-991e-e5e5119e4a37', 'volume_name': 'volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820c3ee-f700-4362-92ab-dfe4ec5277a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820c3ee-f700-4362-92ab-dfe4ec5277a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4d0293-1ae1-46f9-b143-f5d215c7c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Volume f2b9b8b0-3307-47ae-991e-e5e5119e4a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37', 'volume_size': 1} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1735483139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2b9b8b0-3307-47ae-991e-e5e5119e4a37,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54da7771e4bd4216bdfbbd559d638360',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:46Z,use_quota=True,user_id='e0923b0dbee446d5a43e41ed7027609f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Creating volume f2b9b8b0-3307-47ae-991e-e5e5119e4a37 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:46 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:46 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 1073741824 Sep 17 15:01:46 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:46 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 1073741824" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:47 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 Sep 17 15:01:47 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:47 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b4d0293-1ae1-46f9-b143-f5d215c7c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46462b4-6b1b-49e7-8592-5aedf1df0078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Volume volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 (f2b9b8b0-3307-47ae-991e-e5e5119e4a37): created successfully Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f46462b4-6b1b-49e7-8592-5aedf1df0078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Flow 'volume_create_manager' (ce7fdac2-0a8c-4650-a7af-b18be6ac2efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-90567ba8-700a-4ac9-9192-8f50d75c5456 tempest-VolumesTestJSON-864200706 None] Created volume successfully. Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-f2b9b8b0-3307-47ae-991e-e5e5119e4a37-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "cinder-f2b9b8b0-3307-47ae-991e-e5e5119e4a37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-quobyte-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54f1633-a055-473c-8a2b-c9409b56d69c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:49 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 Sep 17 15:01:49 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:49 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:49 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37 Sep 17 15:01:49 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:50 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-f2b9b8b0-3307-47ae-991e-e5e5119e4a37" released by "delete_volume" :: held 0.783s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Created reservations ['352a6c83-b821-44d8-805b-5a0efc1db1bf', 'b25a7b07-c2f4-4341-81af-bc82773e4810', 'f8f7af10-4e58-4745-aef8-c7c817e0d665', '3584c780-adcc-4446-aaef-2080cb933666'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:50 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:50 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-423a6a14-0787-46c6-9f70-cb6e11e27d0e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "cinder-423a6a14-0787-46c6-9f70-cb6e11e27d0e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:50 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.339s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Deleted volume successfully. Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-quobyte-423a6a14-0787-46c6-9f70-cb6e11e27d0e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4442cbd8-6a58-460a-9eae-8d939d2dd8bd tempest-VolumesTestJSON-864200706 None] Lock "cinder-f2b9b8b0-3307-47ae-991e-e5e5119e4a37-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-423a6a14-0787-46c6-9f70-cb6e11e27d0e" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22602f78-3f9a-4885-a6b2-7dcad4a821bc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:50 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e Sep 17 15:01:50 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:51 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:51 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e Sep 17 15:01:51 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:51 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-423a6a14-0787-46c6-9f70-cb6e11e27d0e" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-423a6a14-0787-46c6-9f70-cb6e11e27d0e" released by "delete_volume" :: held 0.734s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Created reservations ['08dea344-30fe-4424-b045-44c3d42a929c', '8cd43ed1-c063-434d-b72b-993a0fed5833', 'fda36508-0bcf-481b-8063-3329f3c0b4d7', '7e5134b3-1c28-4db0-985a-b03777a7badc'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:51 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:51 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-1c0f5ff1-b005-42ad-927a-4a013e67d4dd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:51 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "cinder-1c0f5ff1-b005-42ad-927a-4a013e67d4dd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Deleted volume successfully. Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6efdae1f-8855-4e7b-972d-1fa422730b8c tempest-VolumesTestJSON-864200706 None] Lock "cinder-423a6a14-0787-46c6-9f70-cb6e11e27d0e-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Acquiring lock "cinder-quobyte-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b602d356-a691-499b-b7ab-17f53c09265d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:52 devstack sudo[91397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd Sep 17 15:01:52 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:52 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:52 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd Sep 17 15:01:52 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:52 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "cinder-quobyte-1c0f5ff1-b005-42ad-927a-4a013e67d4dd" released by "delete_volume" :: held 1.009s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Created reservations ['d4ec5f13-915d-4f91-a85f-faad8862a02f', 'a5aae78b-c17c-4e3f-920b-26bc0656d56f', '49339cc2-7bc0-4d2e-99ad-47033446734f', '4c8e582f-02c1-4602-877e-a3cd62f2b434'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:53 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:53 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:53 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.558s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Deleted volume successfully. Sep 17 15:01:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2092d53e-1cd0-4be8-882c-b534fe901d39 tempest-VolumesTestJSON-864200706 None] Lock "cinder-1c0f5ff1-b005-42ad-927a-4a013e67d4dd-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:56 devstack sudo[91508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:01:56 devstack sudo[91508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:57 devstack sudo[91508]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (5b450035-afab-478c-a456-087231b007cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df30c36-4ada-4f19-a356-93a868aeaabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9df30c36-4ada-4f19-a356-93a868aeaabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-841805887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb3b2fc-d2a2-43bd-b81d-fd37e929868e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:58Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f93b6d-0269-413d-a1ed-34a53287bd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f93b6d-0269-413d-a1ed-34a53287bd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37221e73-8bf9-4e3a-b851-11611f74ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37221e73-8bf9-4e3a-b851-11611f74ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb3b2fc-d2a2-43bd-b81d-fd37e929868e', 'volume_name': 'volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b25071-dc26-42b5-83f5-ad0532410461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b25071-dc26-42b5-83f5-ad0532410461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d07b5b-0473-42f8-b7f8-91f5adb27a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Volume cfb3b2fc-d2a2-43bd-b81d-fd37e929868e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e', 'volume_size': 1} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-841805887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb3b2fc-d2a2-43bd-b81d-fd37e929868e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3885f971276d4e5892244aa4d14a7f99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:01:58Z,use_quota=True,user_id='f164522970664daab17ac730838cb4e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Creating volume cfb3b2fc-d2a2-43bd-b81d-fd37e929868e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:01:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:01:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:58 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e 1073741824 Sep 17 15:01:58 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:58 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e 1073741824" returned: 0 in 0.808s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:58 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e Sep 17 15:01:58 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:01:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-df919edb-1451-42de-83e2-97342580c5a6 req-327530c7-61b0-451d-8319-cf3f8edf7657 tempest-ServerActionsTestOtherA-1205983769 None] Terminate volume connection completed successfully. Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-df919edb-1451-42de-83e2-97342580c5a6 req-327530c7-61b0-451d-8319-cf3f8edf7657 tempest-ServerActionsTestOtherA-1205983769 None] Deleting attachment 1aa881ec-6e50-4ad1-bb1b-9f71dc1deaca. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:01:59 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" returned: 0 in 0.378s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d07b5b-0473-42f8-b7f8-91f5adb27a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57bb394-12b1-4b9a-a367-846bb263e227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:01:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Volume volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e (cfb3b2fc-d2a2-43bd-b81d-fd37e929868e): created successfully Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57bb394-12b1-4b9a-a367-846bb263e227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Flow 'volume_create_manager' (5b450035-afab-478c-a456-087231b007cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:01:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b6489f6a-0ff0-4650-a289-0c699f6f7746 tempest-AttachVolumeNegativeTest-904535147 None] Created volume successfully. Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "cinder-1b7f3d19-5225-43c0-be99-71897d3e0044-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-1b7f3d19-5225-43c0-be99-71897d3e0044-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "cinder-quobyte-1b7f3d19-5225-43c0-be99-71897d3e0044" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-quobyte-1b7f3d19-5225-43c0-be99-71897d3e0044" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3263dd80-e11d-48a6-bb1a-e90a2e1de35c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:01:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:01:59 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 Sep 17 15:01:59 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:00 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044" returned: 0 in 0.818s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:00 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044 Sep 17 15:02:00 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:00 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1b7f3d19-5225-43c0-be99-71897d3e0044" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-quobyte-1b7f3d19-5225-43c0-be99-71897d3e0044" released by "delete_volume" :: held 1.264s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:00 devstack cinder-volume[85963]: DEBUG cinder.quota [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Created reservations ['7545cfd1-380b-40c9-b80b-dfb0cc0b4d1c', 'de1ce481-ee58-4bca-98b8-a11c6985ebce', '77319094-466d-4c6f-9704-273b8d24f971', 'c39e7963-025a-4558-b584-a72530d58bf8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:01 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:01 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "cinder-0c3692c4-368a-42f9-957c-0710416ed476-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-0c3692c4-368a-42f9-957c-0710416ed476-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "cinder-quobyte-0c3692c4-368a-42f9-957c-0710416ed476" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-quobyte-0c3692c4-368a-42f9-957c-0710416ed476" acquired by "delete_volume" :: waited 0.056s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393903e-c1f4-4be0-9255-cd3feb1ea60b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1378f3ef-18b5-4660-ae4b-0e425e65d0b1 req-d3bd4a7c-b154-4c13-a51b-e4f9368b5e0f tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1378f3ef-18b5-4660-ae4b-0e425e65d0b1 req-d3bd4a7c-b154-4c13-a51b-e4f9368b5e0f tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1378f3ef-18b5-4660-ae4b-0e425e65d0b1 req-d3bd4a7c-b154-4c13-a51b-e4f9368b5e0f tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:01 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.manager [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Deleted volume successfully. Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-1378f3ef-18b5-4660-ae4b-0e425e65d0b1 req-d3bd4a7c-b154-4c13-a51b-e4f9368b5e0f tempest-AttachVolumeNegativeTest-904535147 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '941e97ea-5ef2-4b7c-8e7f-192b2aa5e42f', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:02:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-df919edb-1451-42de-83e2-97342580c5a6 req-20d09ca3-27af-450b-b31e-e1441899b349 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-1b7f3d19-5225-43c0-be99-71897d3e0044-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:01 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 Sep 17 15:02:01 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-1378f3ef-18b5-4660-ae4b-0e425e65d0b1 req-d3bd4a7c-b154-4c13-a51b-e4f9368b5e0f tempest-AttachVolumeNegativeTest-904535147 None] attachment_update completed successfully. Sep 17 15:02:02 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476" returned: 0 in 0.588s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:02 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476 Sep 17 15:02:02 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:02 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0c3692c4-368a-42f9-957c-0710416ed476" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-quobyte-0c3692c4-368a-42f9-957c-0710416ed476" released by "delete_volume" :: held 1.155s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Created reservations ['b6a002fd-c247-48c1-a44b-b8662b81533f', '6b4d66de-02fb-4424-b29e-a0f495336a2f', 'd48b934b-79b1-4c5a-bf6d-e180ff764c08', '6304466e-37d3-4d6b-b219-883792277816'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:02 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:02 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:03 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3eb655fc-e592-4ded-9e14-d30e272b3b16 tempest-GroupSnapshotsV319Test-1086196654 None] Group tempest-GroupSnapshotsV319Test-Group-772305423: creating Sep 17 15:02:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Deleted volume successfully. Sep 17 15:02:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3eb655fc-e592-4ded-9e14-d30e272b3b16 tempest-GroupSnapshotsV319Test-1086196654 None] Group tempest-GroupSnapshotsV319Test-Group-772305423: created successfully Sep 17 15:02:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3eb655fc-e592-4ded-9e14-d30e272b3b16 tempest-GroupSnapshotsV319Test-1086196654 None] Create group completed successfully. Sep 17 15:02:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3e5f155a-56ce-4f25-abfb-196471b064f1 tempest-ServerActionsTestOtherA-1205983769 None] Lock "cinder-0c3692c4-368a-42f9-957c-0710416ed476-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-d540550b-4778-43e9-9520-da579139c72a req-b04faec9-870a-4657-97a1-92e47613f77a tempest-AttachVolumeNegativeTest-904535147 None] Terminate volume connection completed successfully. Sep 17 15:02:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-d540550b-4778-43e9-9520-da579139c72a req-b04faec9-870a-4657-97a1-92e47613f77a tempest-AttachVolumeNegativeTest-904535147 None] Deleting attachment 941e97ea-5ef2-4b7c-8e7f-192b2aa5e42f. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Flow 'volume_create_manager' (0d31c145-2518-41a3-a49d-77dd08d8b6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0469a655-fd45-4fdf-9166-826ed702de09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0469a655-fd45-4fdf-9166-826ed702de09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-341479646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a32c5bf-cc0e-472a-baab-54815ebe059d,host='devstack@QuobyteHD#QuobyteHD',id=e41f8d49-aa1a-467d-868f-893b41d785ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d86790860145a4b4cdf5f4806def73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:06Z,use_quota=True,user_id='99f4ca8876ee4d95a035ef9aa2cbe243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d08354c-9eb1-4fc5-a072-1c5e69d2cf0c),volume_type_id=3d08354c-9eb1-4fc5-a072-1c5e69d2cf0c)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16af25b-d83e-4e66-9549-19ae1013b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e16af25b-d83e-4e66-9549-19ae1013b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a127d212-3e36-4fcf-b8dc-7a277c92b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a127d212-3e36-4fcf-b8dc-7a277c92b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41f8d49-aa1a-467d-868f-893b41d785ff', 'volume_name': 'volume-e41f8d49-aa1a-467d-868f-893b41d785ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8b8f5d-fb96-44f6-a73c-6b80343ef099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8b8f5d-fb96-44f6-a73c-6b80343ef099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e8788d-a86c-4497-9364-09456344e713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Volume e41f8d49-aa1a-467d-868f-893b41d785ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41f8d49-aa1a-467d-868f-893b41d785ff', 'volume_size': 1} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2a32c5bf-cc0e-472a-baab-54815ebe059d,created_at=2026-09-17T13:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-341479646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2a32c5bf-cc0e-472a-baab-54815ebe059d,host='devstack@QuobyteHD#QuobyteHD',id=e41f8d49-aa1a-467d-868f-893b41d785ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d86790860145a4b4cdf5f4806def73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:06Z,use_quota=True,user_id='99f4ca8876ee4d95a035ef9aa2cbe243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d08354c-9eb1-4fc5-a072-1c5e69d2cf0c),volume_type_id=3d08354c-9eb1-4fc5-a072-1c5e69d2cf0c)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Creating volume e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:05 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff 1073741824 Sep 17 15:02:05 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:06 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff 1073741824" returned: 0 in 0.927s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:06 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff Sep 17 15:02:06 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:07 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff" returned: 0 in 0.642s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e8788d-a86c-4497-9364-09456344e713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41f8d49-aa1a-467d-868f-893b41d785ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c3b5a6-5a01-4732-96ce-74a24be17018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Volume volume-e41f8d49-aa1a-467d-868f-893b41d785ff (e41f8d49-aa1a-467d-868f-893b41d785ff): created successfully Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88c3b5a6-5a01-4732-96ce-74a24be17018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Flow 'volume_create_manager' (0d31c145-2518-41a3-a49d-77dd08d8b6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fde03a6a-68c0-44f1-8ea3-f237c6e2939a tempest-GroupSnapshotsV319Test-1086196654 None] Created volume successfully. Sep 17 15:02:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] GroupSnapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: creating. Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Group snapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Creating offline snapshot eaac2712-1e89-4a0d-858d-2ec0e8f4b349 of volume e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e8d5d8-6880-4456-8f75-c22506d6ac2b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:08 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff Sep 17 15:02:08 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:09 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:09 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 1G Sep 17 15:02:09 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:09 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 1G" returned: 0 in 0.521s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f8d49-aa1a-467d-868f-893b41d785ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:09 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f8d49-aa1a-467d-868f-893b41d785ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 Sep 17 15:02:09 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:09 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41f8d49-aa1a-467d-868f-893b41d785ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:02:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:09 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 Sep 17 15:02:09 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-quobyte-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27d59b1-6503-4f35-82f2-8047685145ce]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:10 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:10 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info Sep 17 15:02:10 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e Sep 17 15:02:10 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:10 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info Sep 17 15:02:10 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:10 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e Sep 17 15:02:10 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:10 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.info" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.321s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:10 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e" released by "delete_volume" :: held 0.774s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Created reservations ['a28724ef-db0e-42b1-8773-7b470b006feb', 'e910b0ed-2abf-4bfd-ac1a-8d0347c603bf', '513d4907-7071-40dd-8318-ee46bb1e3081', '31f57c49-d042-4b5e-b661-cc028434ae65'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1c0c50b5-a08b-47a1-a344-282ee5a681b1 tempest-GroupSnapshotsV319Test-1086196654 None] group_snapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: created successfully Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:11 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:11 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-dc761779-1051-41f1-8ff2-2e713386c34a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:11 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Deleted volume successfully. Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-dc761779-1051-41f1-8ff2-2e713386c34a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cf00a4bf-a362-4ad5-a8a8-f7494414ab50 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-cfb3b2fc-d2a2-43bd-b81d-fd37e929868e-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-quobyte-dc761779-1051-41f1-8ff2-2e713386c34a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-dc761779-1051-41f1-8ff2-2e713386c34a" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786ad84-6c5a-425a-bec3-8dead0c30fc6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:11 devstack sudo[92143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a Sep 17 15:02:11 devstack sudo[92143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:11 devstack sudo[92143]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:11 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a Sep 17 15:02:11 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:12 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc761779-1051-41f1-8ff2-2e713386c34a" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-dc761779-1051-41f1-8ff2-2e713386c34a" released by "delete_volume" :: held 0.755s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] group_snapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: deleting Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] group_snapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "cinder-quobyte-eaac2712-1e89-4a0d-858d-2ec0e8f4b349" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Created reservations ['ad878da4-613f-4843-a4ef-82c14a5b34a1', 'cbbae80e-dcb3-42ca-95e2-09461c9f4059', '4e388e86-185a-4af8-b946-f544233984a8', '44df7933-978f-49e3-bd2f-6dce903e4332'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-eaac2712-1e89-4a0d-858d-2ec0e8f4b349" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Deleting offline snapshot eaac2712-1e89-4a0d-858d-2ec0e8f4b349 of volume e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] snapshot_file for this snap is: volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe91141d-caed-4c4f-99e1-5d0accbd3f8b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:12 devstack sudo[92153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:12 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:12 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 Sep 17 15:02:12 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:12 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Deleted volume successfully. Sep 17 15:02:12 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-51b17664-8e45-4f86-8690-2e99fcd157e7 tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-dc761779-1051-41f1-8ff2-2e713386c34a-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41f8d49-aa1a-467d-868f-893b41d785ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-8dc58ee0-f4dd-4474-871e-484787e1001f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e8c59-39fe-4f02-905c-87b67b9351c4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-8dc58ee0-f4dd-4474-871e-484787e1001f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "cinder-quobyte-8dc58ee0-f4dd-4474-871e-484787e1001f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-8dc58ee0-f4dd-4474-871e-484787e1001f" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a783a8b-9e15-4dbb-8589-5c393c4de61f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:12 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff Sep 17 15:02:12 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:13 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f Sep 17 15:02:13 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:13 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:13 devstack sudo[92169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 Sep 17 15:02:13 devstack sudo[92169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:13 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f" returned: 0 in 0.517s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:13 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f Sep 17 15:02:13 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:13 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8dc58ee0-f4dd-4474-871e-484787e1001f" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:13 devstack sudo[92169]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-quobyte-8dc58ee0-f4dd-4474-871e-484787e1001f" released by "delete_volume" :: held 0.858s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:13 devstack sudo[92179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349 Sep 17 15:02:13 devstack sudo[92179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Created reservations ['8c67da1b-4150-4f38-8e91-067ae9dbede6', 'e77e8fc6-68a4-4e09-af63-cc57d005004b', '2fda86e2-9890-4bdc-87b1-de7091b8d695', 'bfa3d800-a65f-46ad-b250-059718579a10'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:13 devstack sudo[92181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:13 devstack sudo[92181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:14 devstack sudo[92179]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff.eaac2712-1e89-4a0d-858d-2ec0e8f4b349" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-eaac2712-1e89-4a0d-858d-2ec0e8f4b349" released by "_delete_snapshot" :: held 1.844s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" released by "delete_snapshot" :: held 1.887s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:14 devstack cinder-volume[85963]: WARNING cinder.quota [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813277930 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-813277930, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:14 devstack cinder-volume[85963]: WARNING cinder.quota [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-813277930 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-813277930, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] Created reservations ['975ba0f2-4bc9-4d12-a020-03c8fe20c5fb', 'aeeb06a0-4a82-40a5-9715-a15cf7f8f22b', '054892cf-4989-42f7-bfeb-8555507a8cf6', 'a11ee9c4-21a9-41ee-847f-c9ab625429e3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:14 devstack sudo[92181]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Deleted volume successfully. Sep 17 15:02:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e5196b5-9bcc-4794-8f22-11601264305c tempest-AttachVolumeNegativeTest-904535147 None] Lock "cinder-8dc58ee0-f4dd-4474-871e-484787e1001f-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-96e72dd7-6d76-4704-a3f2-1b4fcfb25afd tempest-GroupSnapshotsV319Test-1086196654 None] group_snapshot 82e0d303-3528-49d1-9d3b-e0671f5ed120: deleted successfully Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3191b3-b360-4961-bbdc-ca44cdafd942]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:15 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff Sep 17 15:02:15 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:15 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:15 devstack sudo[92191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff Sep 17 15:02:15 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:15 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e41f8d49-aa1a-467d-868f-893b41d785ff" returned: 0 in 0.305s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "cinder-quobyte-e41f8d49-aa1a-467d-868f-893b41d785ff" released by "delete_volume" :: held 0.946s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Created reservations ['0b9eeede-11db-4225-abd0-a4d36f3803af'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:16 devstack cinder-volume[85963]: WARNING cinder.quota [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-813277930 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-813277930, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Created reservations ['56781fcc-3f0f-4031-a6bc-23a805f7c61c', 'd49fbe95-55b8-4c77-b064-ce3269542d32', 'b0b55857-d66d-403e-8ac6-b396069c2a1e', '492d3838-95de-4aa5-8e54-893e16e8aa60'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:16 devstack sudo[92194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:16 devstack sudo[92194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:16 devstack sudo[92194]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-58568937-1abb-435b-a4a7-cc0ea0a68303 tempest-GroupSnapshotsV319Test-1086196654 None] Delete group completed successfully. Sep 17 15:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (c5c180d4-ceaa-4ddb-a0e4-63fbfd5b95a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d424dec-0183-4db0-b6a5-4037bc7317fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d424dec-0183-4db0-b6a5-4037bc7317fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095493164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bbd83e-8204-4dfa-acda-bbe960d74edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:20Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45afa36d-0086-461b-98d5-b66ff5a779fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45afa36d-0086-461b-98d5-b66ff5a779fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534e72c1-5e42-4309-a9a6-af3d62e077a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534e72c1-5e42-4309-a9a6-af3d62e077a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77bbd83e-8204-4dfa-acda-bbe960d74edd', 'volume_name': 'volume-77bbd83e-8204-4dfa-acda-bbe960d74edd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef871243-653b-4545-be73-045651bc89fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef871243-653b-4545-be73-045651bc89fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e5107d-bf9a-449b-a70c-2831263b8f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Volume 77bbd83e-8204-4dfa-acda-bbe960d74edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77bbd83e-8204-4dfa-acda-bbe960d74edd', 'volume_size': 1} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2095493164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77bbd83e-8204-4dfa-acda-bbe960d74edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:20Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Creating volume 77bbd83e-8204-4dfa-acda-bbe960d74edd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:20 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:20 devstack sudo[92200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd 1073741824 Sep 17 15:02:20 devstack sudo[92200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:20 devstack sudo[92200]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd 1073741824" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:20 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd Sep 17 15:02:20 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:20 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e5107d-bf9a-449b-a70c-2831263b8f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77bbd83e-8204-4dfa-acda-bbe960d74edd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fac45b2-bade-4d3f-91f0-f9334c3984f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Volume volume-77bbd83e-8204-4dfa-acda-bbe960d74edd (77bbd83e-8204-4dfa-acda-bbe960d74edd): created successfully Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fac45b2-bade-4d3f-91f0-f9334c3984f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (c5c180d4-ceaa-4ddb-a0e4-63fbfd5b95a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d894afe5-7afa-492d-ae9b-3b7a02f9d2d4 tempest-AttachVolumeTestJSON-496948220 None] Created volume successfully. Sep 17 15:02:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8878efa2-aa39-43fe-b5e8-6f055009968a req-d4d09c4d-5247-4488-afe6-3bcb702d1647 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8878efa2-aa39-43fe-b5e8-6f055009968a req-d4d09c4d-5247-4488-afe6-3bcb702d1647 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-8878efa2-aa39-43fe-b5e8-6f055009968a req-d4d09c4d-5247-4488-afe6-3bcb702d1647 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-8878efa2-aa39-43fe-b5e8-6f055009968a req-d4d09c4d-5247-4488-afe6-3bcb702d1647 tempest-AttachVolumeTestJSON-496948220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-77bbd83e-8204-4dfa-acda-bbe960d74edd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd0431e8-591b-4fb0-ac85-0f660d32890e', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:02:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-8878efa2-aa39-43fe-b5e8-6f055009968a req-d4d09c4d-5247-4488-afe6-3bcb702d1647 tempest-AttachVolumeTestJSON-496948220 None] attachment_update completed successfully. Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=129,cinder:SELECT=106,cinder:DELETE=6,cinder:INSERT=32 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=107,cinder:INSERT=26,cinder:UPDATE=119,cinder:DELETE=11 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Flow 'volume_create_manager' (09776a5a-b609-4939-ba15-58c3bce6691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc080894-f3d7-4f19-924f-2abb2f35e6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-52f722cd-5805-41a1-b0a8-1c748d84bcc4 tempest-GroupsTest-1845883145 None] Group tempest-Group1-177532313: creating Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc080894-f3d7-4f19-924f-2abb2f35e6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-997202103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c704aa-2119-4aa4-b528-b4ad5c283650,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4695da7408c4490bac3a95b918aa859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:26Z,use_quota=True,user_id='e63e60d3a5c647e3b80c62290275392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70faadf-8047-41a6-bd06-2f07592a1f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70faadf-8047-41a6-bd06-2f07592a1f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae55f8b-2676-4a03-8ce0-e5ff02dd4535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ae55f8b-2676-4a03-8ce0-e5ff02dd4535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c704aa-2119-4aa4-b528-b4ad5c283650', 'volume_name': 'volume-a3c704aa-2119-4aa4-b528-b4ad5c283650', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4226b2-eac3-4ecb-80df-b98ba8d20ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c4226b2-eac3-4ecb-80df-b98ba8d20ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1ed0a4-fc63-49e1-af42-21eb899c650d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Volume a3c704aa-2119-4aa4-b528-b4ad5c283650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c704aa-2119-4aa4-b528-b4ad5c283650', 'volume_size': 1} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-997202103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c704aa-2119-4aa4-b528-b4ad5c283650,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4695da7408c4490bac3a95b918aa859a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:26Z,use_quota=True,user_id='e63e60d3a5c647e3b80c62290275392a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Creating volume a3c704aa-2119-4aa4-b528-b4ad5c283650 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:25 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 1073741824 Sep 17 15:02:25 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-52f722cd-5805-41a1-b0a8-1c748d84bcc4 tempest-GroupsTest-1845883145 None] Group tempest-Group1-177532313: created successfully Sep 17 15:02:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-52f722cd-5805-41a1-b0a8-1c748d84bcc4 tempest-GroupsTest-1845883145 None] Create group completed successfully. Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (6dd3d904-e54e-43cd-8fac-cb63e3b9e95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a391fa27-154f-4f23-9e08-c04e49912dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a391fa27-154f-4f23-9e08-c04e49912dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220150547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23996ce7-8fed-4732-b917-f9f016b174bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:26Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd16cb86-bf92-40af-b12a-5e9ec4ba7006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd16cb86-bf92-40af-b12a-5e9ec4ba7006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ad971-1cca-4060-a36c-c1d3dd0b09f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142ad971-1cca-4060-a36c-c1d3dd0b09f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23996ce7-8fed-4732-b917-f9f016b174bb', 'volume_name': 'volume-23996ce7-8fed-4732-b917-f9f016b174bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76be644f-c24a-4ba7-890c-0c40dda1b573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76be644f-c24a-4ba7-890c-0c40dda1b573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571aef2-b42d-4295-9106-d69d856076ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Volume 23996ce7-8fed-4732-b917-f9f016b174bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23996ce7-8fed-4732-b917-f9f016b174bb', 'volume_size': 1} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:26 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 1073741824" returned: 0 in 0.591s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:26 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 Sep 17 15:02:26 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:26 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220150547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23996ce7-8fed-4732-b917-f9f016b174bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700d069b1e80420f91e1d7d09751fece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:26Z,use_quota=True,user_id='e486d89050a44ec68048ff5108a65a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Creating volume 23996ce7-8fed-4732-b917-f9f016b174bb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf1ed0a4-fc63-49e1-af42-21eb899c650d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c704aa-2119-4aa4-b528-b4ad5c283650', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb 1073741824 Sep 17 15:02:26 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea90d2c-3ef3-4f5b-831b-4bbe0762fd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Volume volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 (a3c704aa-2119-4aa4-b528-b4ad5c283650): created successfully Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea90d2c-3ef3-4f5b-831b-4bbe0762fd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Flow 'volume_create_manager' (09776a5a-b609-4939-ba15-58c3bce6691b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e2d2dbf0-d39c-49c6-a4dc-fbb74f26f2a9 tempest-GroupsTest-1845883145 None] Group tempest-Group2-182708657: creating Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-9363a982-16f0-4a12-8569-5329c42e3951 req-1970244f-17fc-48ba-b2ed-c474542a6731 tempest-VolumesGetTestJSON-428722092 None] Created volume successfully. Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e2d2dbf0-d39c-49c6-a4dc-fbb74f26f2a9 tempest-GroupsTest-1845883145 None] Group tempest-Group2-182708657: created successfully Sep 17 15:02:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e2d2dbf0-d39c-49c6-a4dc-fbb74f26f2a9 tempest-GroupsTest-1845883145 None] Create group completed successfully. Sep 17 15:02:27 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb 1073741824" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:27 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb Sep 17 15:02:27 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:27 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a571aef2-b42d-4295-9106-d69d856076ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23996ce7-8fed-4732-b917-f9f016b174bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c473a2f-d8c9-4522-b704-6bd84eb3f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Volume volume-23996ce7-8fed-4732-b917-f9f016b174bb (23996ce7-8fed-4732-b917-f9f016b174bb): created successfully Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c473a2f-d8c9-4522-b704-6bd84eb3f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Flow 'volume_create_manager' (6dd3d904-e54e-43cd-8fac-cb63e3b9e95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-77d69979-487b-4e4d-9334-db5c61e13444 tempest-AttachVolumeTestJSON-496948220 None] Created volume successfully. Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Acquiring lock "cinder-a3c704aa-2119-4aa4-b528-b4ad5c283650-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "cinder-a3c704aa-2119-4aa4-b528-b4ad5c283650-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Acquiring lock "cinder-quobyte-a3c704aa-2119-4aa4-b528-b4ad5c283650" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "cinder-quobyte-a3c704aa-2119-4aa4-b528-b4ad5c283650" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bc964f-7280-4130-91cb-51c19b42bbce]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:28 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 Sep 17 15:02:28 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:28 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:28 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650 Sep 17 15:02:28 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (97ab00e0-4971-43b2-9e7d-c3b13734eb8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c808693-c7fb-4bcf-8c72-7c279ccdef7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c808693-c7fb-4bcf-8c72-7c279ccdef7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920355456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58106645-10cc-4f7c-bc66-73801267bbdb,host='devstack@QuobyteHD#QuobyteHD',id=71daebde-b128-4baa-af54-b23348ebb112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:29Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4db04e76-344c-40c3-914f-b10cb20739fe),volume_type_id=4db04e76-344c-40c3-914f-b10cb20739fe)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f65d42-ff87-4b73-b403-703bde05cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f65d42-ff87-4b73-b403-703bde05cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287bdac6-40e3-4078-aaf7-d396155da238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (287bdac6-40e3-4078-aaf7-d396155da238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71daebde-b128-4baa-af54-b23348ebb112', 'volume_name': 'volume-71daebde-b128-4baa-af54-b23348ebb112', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66a6e84-765f-4fd3-b889-c7b7a7b3f3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d66a6e84-765f-4fd3-b889-c7b7a7b3f3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4690dc8a-a508-444b-ace9-f1d350a0211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Volume 71daebde-b128-4baa-af54-b23348ebb112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71daebde-b128-4baa-af54-b23348ebb112', 'volume_size': 1} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58106645-10cc-4f7c-bc66-73801267bbdb,created_at=2026-09-17T13:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-920355456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58106645-10cc-4f7c-bc66-73801267bbdb,host='devstack@QuobyteHD#QuobyteHD',id=71daebde-b128-4baa-af54-b23348ebb112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:29Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4db04e76-344c-40c3-914f-b10cb20739fe),volume_type_id=4db04e76-344c-40c3-914f-b10cb20739fe)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Creating volume 71daebde-b128-4baa-af54-b23348ebb112 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:29 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 1073741824 Sep 17 15:02:29 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:29 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a3c704aa-2119-4aa4-b528-b4ad5c283650" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "cinder-quobyte-a3c704aa-2119-4aa4-b528-b4ad5c283650" released by "delete_volume" :: held 0.932s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.quota [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Created reservations ['bc0fdba5-de23-47ce-8dc8-8612818645f8', 'bf2025f0-4038-4e4f-953b-2487aa064208', '6c9b793f-d7af-477f-8de4-6ef11477b273', '1a547513-c21c-4453-8c05-c56b491a58e4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-aa9a2320-901a-47a1-addf-17af15ebf0b0 req-f71a29c1-f508-443f-a802-847f6336b8c0 tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:29 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:29 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:29 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.308s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.manager [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Deleted volume successfully. Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-62f79f7b-7c3a-4922-8dfb-94e6db7d799c req-a4362d6f-9147-49d9-9a02-ef06bf6cbaab tempest-VolumesGetTestJSON-428722092 None] Lock "cinder-a3c704aa-2119-4aa4-b528-b4ad5c283650-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:29 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 1073741824" returned: 0 in 0.900s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:30 devstack sudo[92686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 Sep 17 15:02:30 devstack sudo[92686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:30 devstack sudo[92686]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-aa9a2320-901a-47a1-addf-17af15ebf0b0 req-f71a29c1-f508-443f-a802-847f6336b8c0 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.897s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-aa9a2320-901a-47a1-addf-17af15ebf0b0 req-f71a29c1-f508-443f-a802-847f6336b8c0 tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4690dc8a-a508-444b-ace9-f1d350a0211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71daebde-b128-4baa-af54-b23348ebb112', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61238db1-46f0-451c-ba38-cf1a95cc6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Volume volume-71daebde-b128-4baa-af54-b23348ebb112 (71daebde-b128-4baa-af54-b23348ebb112): created successfully Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61238db1-46f0-451c-ba38-cf1a95cc6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (97ab00e0-4971-43b2-9e7d-c3b13734eb8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-aa9a2320-901a-47a1-addf-17af15ebf0b0 req-f71a29c1-f508-443f-a802-847f6336b8c0 tempest-AttachVolumeTestJSON-496948220 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-23996ce7-8fed-4732-b917-f9f016b174bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f80e5cd5-f55c-4d72-ba63-a7481d13e5e8', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:02:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-809df73a-9aca-4957-ac4b-36f7aebc29dc tempest-GroupsTest-1845883145 None] Created volume successfully. Sep 17 15:02:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-aa9a2320-901a-47a1-addf-17af15ebf0b0 req-f71a29c1-f508-443f-a802-847f6336b8c0 tempest-AttachVolumeTestJSON-496948220 None] attachment_update completed successfully. Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Acquiring lock "cinder-quobyte-71daebde-b128-4baa-af54-b23348ebb112" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-71daebde-b128-4baa-af54-b23348ebb112" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aab51c-fcc6-4d68-92f7-0439a0523803]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-a9c4717c-c7d1-4ccc-966e-bfbb621e2b27 req-2244e788-873c-435a-8a3a-2ab6cf16eaa9 tempest-AttachVolumeTestJSON-496948220 None] Terminate volume connection completed successfully. Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-a9c4717c-c7d1-4ccc-966e-bfbb621e2b27 req-2244e788-873c-435a-8a3a-2ab6cf16eaa9 tempest-AttachVolumeTestJSON-496948220 None] Deleting attachment cd0431e8-591b-4fb0-ac85-0f660d32890e. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:02:32 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 Sep 17 15:02:32 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:32 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112" returned: 0 in 0.600s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:32 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112 Sep 17 15:02:32 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:33 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71daebde-b128-4baa-af54-b23348ebb112" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-71daebde-b128-4baa-af54-b23348ebb112" released by "delete_volume" :: held 1.053s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Created reservations ['154006f4-3349-493d-92bd-764ea0aa06ba'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1116168060 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1116168060, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1116168060 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1116168060, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Created reservations ['73167aa9-977d-4112-840b-d2fbb92c897c', 'd37f6182-eba8-4dc4-ad42-d485f16f28b0', 'e20051f0-2448-427d-923e-092f1c1efedc', 'dc445910-a064-4589-abef-ee316d3b8b94'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:33 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:33 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:33 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a4503293-41dd-41c7-b8df-a5186275c81f tempest-GroupsTest-1845883145 None] Delete group completed successfully. Sep 17 15:02:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e8db17fc-3559-41a7-a0fc-eae50165eeff req-e58ecc7e-2d90-421f-a0a7-5f8e0148b84b tempest-AttachVolumeTestJSON-496948220 None] Terminate volume connection completed successfully. Sep 17 15:02:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e8db17fc-3559-41a7-a0fc-eae50165eeff req-e58ecc7e-2d90-421f-a0a7-5f8e0148b84b tempest-AttachVolumeTestJSON-496948220 None] Deleting attachment f80e5cd5-f55c-4d72-ba63-a7481d13e5e8. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Created reservations ['bc4d64db-b20f-4895-8cad-2761db277726'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:35 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:35 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:35 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.556s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-31ec5778-3526-4b85-9eae-792f93bcbdb7 tempest-GroupsTest-1845883145 None] Delete group completed successfully. Sep 17 15:02:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ba0962f4-a572-46e3-b238-9ef85a14a152 tempest-GroupsTest-1845883145 None] Group tempest-GroupsTest-Group-236239904: creating Sep 17 15:02:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ba0962f4-a572-46e3-b238-9ef85a14a152 tempest-GroupsTest-1845883145 None] Group tempest-GroupsTest-Group-236239904: created successfully Sep 17 15:02:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ba0962f4-a572-46e3-b238-9ef85a14a152 tempest-GroupsTest-1845883145 None] Create group completed successfully. Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (f56b55a3-b651-4dfa-9b32-a1a75326298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0780f6f-01e8-44bb-8b71-e8fe36eaa8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0780f6f-01e8-44bb-8b71-e8fe36eaa8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240364322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f55161-4b50-4690-9086-cb24177165f9,host='devstack@QuobyteHD#QuobyteHD',id=6c7e4041-a57d-40fb-9299-950aa855e8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:39Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49be8828-bc5c-48d6-9bbf-e0a1face3084),volume_type_id=49be8828-bc5c-48d6-9bbf-e0a1face3084)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f1edc3-11ba-4925-9304-29be1afbbda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2f1edc3-11ba-4925-9304-29be1afbbda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d356ff82-6971-4221-9bc5-6456208cdfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d356ff82-6971-4221-9bc5-6456208cdfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7e4041-a57d-40fb-9299-950aa855e8d9', 'volume_name': 'volume-6c7e4041-a57d-40fb-9299-950aa855e8d9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a61985-3075-450e-b736-0db4cdb40a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a61985-3075-450e-b736-0db4cdb40a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c147924-5713-43db-816f-7f0065adee15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Volume 6c7e4041-a57d-40fb-9299-950aa855e8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7e4041-a57d-40fb-9299-950aa855e8d9', 'volume_size': 1} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19f55161-4b50-4690-9086-cb24177165f9,created_at=2026-09-17T13:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1240364322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f55161-4b50-4690-9086-cb24177165f9,host='devstack@QuobyteHD#QuobyteHD',id=6c7e4041-a57d-40fb-9299-950aa855e8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:39Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49be8828-bc5c-48d6-9bbf-e0a1face3084),volume_type_id=49be8828-bc5c-48d6-9bbf-e0a1face3084)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Creating volume 6c7e4041-a57d-40fb-9299-950aa855e8d9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:39 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:39 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 1073741824 Sep 17 15:02:39 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:40 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 1073741824" returned: 0 in 0.639s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:40 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 Sep 17 15:02:40 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:40 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c147924-5713-43db-816f-7f0065adee15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7e4041-a57d-40fb-9299-950aa855e8d9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd92ac-56ea-466f-93a3-925a60bff774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Volume volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 (6c7e4041-a57d-40fb-9299-950aa855e8d9): created successfully Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3bd92ac-56ea-466f-93a3-925a60bff774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (f56b55a3-b651-4dfa-9b32-a1a75326298f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9e70c4f2-74e7-4059-b280-44321a9f5d88 tempest-GroupsTest-1845883145 None] Created volume successfully. Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-23996ce7-8fed-4732-b917-f9f016b174bb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-23996ce7-8fed-4732-b917-f9f016b174bb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-quobyte-23996ce7-8fed-4732-b917-f9f016b174bb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-23996ce7-8fed-4732-b917-f9f016b174bb" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c22930-5c4b-41bc-8072-4aa4b7c6b2b3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:42 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb Sep 17 15:02:42 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (8afec29b-d38f-4f0e-ab23-34db35054131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eeb651-2ea5-4555-8710-82b69101d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12eeb651-2ea5-4555-8710-82b69101d792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481902239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f55161-4b50-4690-9086-cb24177165f9,host='devstack@QuobyteHD#QuobyteHD',id=8815a747-2810-4b29-a70e-fe81420e8b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:43Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49be8828-bc5c-48d6-9bbf-e0a1face3084),volume_type_id=49be8828-bc5c-48d6-9bbf-e0a1face3084)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd8aff4-0239-4103-93e2-37d4da0ae010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd8aff4-0239-4103-93e2-37d4da0ae010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:43 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63261e2-c7df-42fd-96e8-c162eb259732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63261e2-c7df-42fd-96e8-c162eb259732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8815a747-2810-4b29-a70e-fe81420e8b37', 'volume_name': 'volume-8815a747-2810-4b29-a70e-fe81420e8b37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9087485b-7c46-4895-b496-7887308c7713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9087485b-7c46-4895-b496-7887308c7713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f3c40-f072-4b0b-99a5-b010af2d7d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Volume 8815a747-2810-4b29-a70e-fe81420e8b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8815a747-2810-4b29-a70e-fe81420e8b37', 'volume_size': 1} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=19f55161-4b50-4690-9086-cb24177165f9,created_at=2026-09-17T13:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481902239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=19f55161-4b50-4690-9086-cb24177165f9,host='devstack@QuobyteHD#QuobyteHD',id=8815a747-2810-4b29-a70e-fe81420e8b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af620daae9db43359b5ae18d4d09ed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:43Z,use_quota=True,user_id='61bab70ede1e435f894a8262065fa57f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49be8828-bc5c-48d6-9bbf-e0a1face3084),volume_type_id=49be8828-bc5c-48d6-9bbf-e0a1face3084)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Creating volume 8815a747-2810-4b29-a70e-fe81420e8b37 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb" returned: 0 in 0.857s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:43 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 1073741824 Sep 17 15:02:43 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:43 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb Sep 17 15:02:43 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:44 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-23996ce7-8fed-4732-b917-f9f016b174bb" returned: 0 in 0.810s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-23996ce7-8fed-4732-b917-f9f016b174bb" released by "delete_volume" :: held 1.774s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Created reservations ['eba6c566-7898-406b-a169-92763af4e241', '89042938-67b8-463d-9251-196f5482ab77', 'ae252c7f-3e6c-4220-953d-1d30d137775c', '25ac5fc3-2d81-4c77-986d-a38185c7af78'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:44 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 1073741824" returned: 0 in 1.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:44 devstack sudo[92966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:44 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:45 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 Sep 17 15:02:45 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-77bbd83e-8204-4dfa-acda-bbe960d74edd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-77bbd83e-8204-4dfa-acda-bbe960d74edd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:45 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37" returned: 0 in 0.587s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:45 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.896s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (848f3c40-f072-4b0b-99a5-b010af2d7d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8815a747-2810-4b29-a70e-fe81420e8b37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f854dc88-3d36-43da-b757-b59acba477d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Deleted volume successfully. Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-quobyte-77bbd83e-8204-4dfa-acda-bbe960d74edd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Volume volume-8815a747-2810-4b29-a70e-fe81420e8b37 (8815a747-2810-4b29-a70e-fe81420e8b37): created successfully Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f854dc88-3d36-43da-b757-b59acba477d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Flow 'volume_create_manager' (8afec29b-d38f-4f0e-ab23-34db35054131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-77bbd83e-8204-4dfa-acda-bbe960d74edd" acquired by "delete_volume" :: waited 0.062s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8adc3bb-47b1-4e00-8dd0-07fa10435b5f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-14516ba5-38b9-4752-860c-dc4a45d4edb3 tempest-GroupsTest-1845883145 None] Created volume successfully. Sep 17 15:02:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9af54fb2-41d4-400a-877c-3fa8c39e190b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-23996ce7-8fed-4732-b917-f9f016b174bb-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:46 devstack sudo[92973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd Sep 17 15:02:46 devstack sudo[92973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:46 devstack sudo[92973]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd" returned: 0 in 1.071s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:47 devstack sudo[92981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd Sep 17 15:02:47 devstack sudo[92981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-28b4df2e-74ac-4e3d-bdc0-b2a2606d7d54 tempest-GroupsTest-1845883145 None] Update group completed successfully. Sep 17 15:02:47 devstack sudo[92981]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77bbd83e-8204-4dfa-acda-bbe960d74edd" returned: 0 in 0.789s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-77bbd83e-8204-4dfa-acda-bbe960d74edd" released by "delete_volume" :: held 1.955s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Created reservations ['8494a90d-7b78-45af-8d9d-1060939192f3', 'e00cba16-d52a-479d-aed2-4ce76ac71c52', 'a25a9006-bf89-4b23-bb40-5b637648e520', '9c7abb79-5463-47fb-90fa-6be30aba83b9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:48 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:48 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:48 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Deleted volume successfully. Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-24358a08-1f3f-46b8-b4f8-99cc81a9e98a tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-77bbd83e-8204-4dfa-acda-bbe960d74edd-delete_volume" released by "delete_volume" :: held 3.127s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-aa56c128-e7af-463f-afed-10136a5f171b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-aa56c128-e7af-463f-afed-10136a5f171b-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "cinder-quobyte-aa56c128-e7af-463f-afed-10136a5f171b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-aa56c128-e7af-463f-afed-10136a5f171b" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4838b8-5fd6-4cfc-bc95-71d22ffadf2f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:49 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b Sep 17 15:02:49 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:49 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b" returned: 0 in 0.740s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-519b9029-11ea-43ef-b887-863fd0a84b08 tempest-GroupsTest-1845883145 None] Update group completed successfully. Sep 17 15:02:49 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b Sep 17 15:02:49 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:50 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aa56c128-e7af-463f-afed-10136a5f171b" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-quobyte-aa56c128-e7af-463f-afed-10136a5f171b" released by "delete_volume" :: held 1.288s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Created reservations ['04b2e18d-ec8a-4aa2-9788-59f75d2a8d9c', '8f98f0d7-a06b-47c4-be5b-57e0d14f6dee', '6ade7e34-3f91-4e86-9c94-a3a61ca2fde6', '08c6eef6-412c-429b-b54d-3ad0f87500e0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:50 devstack sudo[93009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:50 devstack sudo[93009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:50 devstack sudo[93009]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Deleted volume successfully. Sep 17 15:02:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94e7e4b5-5fda-418b-876d-5924433f9d3b tempest-AttachVolumeTestJSON-496948220 None] Lock "cinder-aa56c128-e7af-463f-afed-10136a5f171b-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Acquiring lock "cinder-quobyte-6c7e4041-a57d-40fb-9299-950aa855e8d9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-6c7e4041-a57d-40fb-9299-950aa855e8d9" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1fe1a4-e0f9-490b-8ee8-5d76210b1bed]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:52 devstack sudo[93041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 Sep 17 15:02:52 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:52 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9" returned: 0 in 0.688s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:52 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9 Sep 17 15:02:52 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:53 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c7e4041-a57d-40fb-9299-950aa855e8d9" returned: 0 in 0.582s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-6c7e4041-a57d-40fb-9299-950aa855e8d9" released by "delete_volume" :: held 1.372s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Acquiring lock "cinder-quobyte-8815a747-2810-4b29-a70e-fe81420e8b37" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-8815a747-2810-4b29-a70e-fe81420e8b37" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc2472-eaa1-4fbb-b726-1f0ecc2fd6a3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:53 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 Sep 17 15:02:53 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:53 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:53 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37 Sep 17 15:02:53 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:54 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8815a747-2810-4b29-a70e-fe81420e8b37" returned: 0 in 0.814s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "cinder-quobyte-8815a747-2810-4b29-a70e-fe81420e8b37" released by "delete_volume" :: held 1.580s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:02:54 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Created reservations ['15a5ab65-e66e-49da-9f4a-b7d4bdb9e875'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:55 devstack cinder-volume[85963]: WARNING cinder.quota [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-9570583 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-9570583, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:55 devstack cinder-volume[85963]: WARNING cinder.quota [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-9570583 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-9570583, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Created reservations ['d233a677-a02a-4131-80dc-edbe4bc7d998', '47ee24ee-1ee3-4e69-abe2-13e12e9e0e4d', 'a72c3a9c-f904-46bd-9a79-546daef7f5c6', 'cbf79f49-a606-4f2b-953b-4382cf43cdb6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Created reservations ['6517aafe-dc02-492e-b085-52533a009694', '7b08f148-a1db-4f3b-9a46-3141aaaa2f9f', 'e746fd86-afbe-4758-b067-478f758dd1eb', '795f1cf3-7cd6-4b87-96c0-7dfe42a9a78a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:55 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:55 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Flow 'volume_create_manager' (389458f1-3b4f-4883-85e8-0af8fa0ff5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb304886-c10b-4b93-a116-b0554d960b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb304886-c10b-4b93-a116-b0554d960b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1887418971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaee4482-edf9-4ca1-b257-bc3ce8804059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5575dc0460024d7f993aa697eddb662e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:56Z,use_quota=True,user_id='130039719d9941aab279c28aa48ba323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689c2ae2-1f7d-4646-9a6b-30643b951349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689c2ae2-1f7d-4646-9a6b-30643b951349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e343f6-b69d-41bc-84d8-31639ac9b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e343f6-b69d-41bc-84d8-31639ac9b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaee4482-edf9-4ca1-b257-bc3ce8804059', 'volume_name': 'volume-eaee4482-edf9-4ca1-b257-bc3ce8804059', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cd601e-1846-4e1c-b035-d90d99688f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cd601e-1846-4e1c-b035-d90d99688f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c55810-cf7b-4601-b71e-67a55f138dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Volume eaee4482-edf9-4ca1-b257-bc3ce8804059: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaee4482-edf9-4ca1-b257-bc3ce8804059', 'volume_size': 1} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1887418971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaee4482-edf9-4ca1-b257-bc3ce8804059,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5575dc0460024d7f993aa697eddb662e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:02:56Z,use_quota=True,user_id='130039719d9941aab279c28aa48ba323',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Creating volume eaee4482-edf9-4ca1-b257-bc3ce8804059 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:02:56 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:56 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8422cbc2-4d61-4f7a-b393-68e65512ec3c tempest-GroupsTest-1845883145 None] Delete group completed successfully. Sep 17 15:02:56 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 1073741824 Sep 17 15:02:56 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:56 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 1073741824" returned: 0 in 0.841s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:02:56 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:02:56 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:57 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 Sep 17 15:02:57 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:02:57 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:02:57 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c55810-cf7b-4601-b71e-67a55f138dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaee4482-edf9-4ca1-b257-bc3ce8804059', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce47bbd5-3e49-4676-bfb7-bf158a942fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:02:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Volume volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 (eaee4482-edf9-4ca1-b257-bc3ce8804059): created successfully Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce47bbd5-3e49-4676-bfb7-bf158a942fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:02:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Flow 'volume_create_manager' (389458f1-3b4f-4883-85e8-0af8fa0ff5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:02:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f2f27b2a-e3ab-4bc3-9f99-edb866b09626 tempest-ServerRescueNegativeTestJSON-135249360 None] Created volume successfully. Sep 17 15:03:07 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=87,cinder:SELECT=77,cinder:DELETE=5,cinder:INSERT=21 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:07 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=73,cinder:UPDATE=88,cinder:INSERT=16,cinder:DELETE=5 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5fee1070-5dbf-4a71-be30-7ff469e84232 tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-1840252783: creating Sep 17 15:03:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5fee1070-5dbf-4a71-be30-7ff469e84232 tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-1840252783: created successfully Sep 17 15:03:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5fee1070-5dbf-4a71-be30-7ff469e84232 tempest-GroupSnapshotsTest-1252094835 None] Create group completed successfully. Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Acquiring lock "cinder-eaee4482-edf9-4ca1-b257-bc3ce8804059-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "cinder-eaee4482-edf9-4ca1-b257-bc3ce8804059-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Acquiring lock "cinder-quobyte-eaee4482-edf9-4ca1-b257-bc3ce8804059" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "cinder-quobyte-eaee4482-edf9-4ca1-b257-bc3ce8804059" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e860560c-c793-4faf-ab44-924f2fe4ebfb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:11 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 Sep 17 15:03:11 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:11 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059" returned: 0 in 0.576s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:11 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059 Sep 17 15:03:11 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:11 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eaee4482-edf9-4ca1-b257-bc3ce8804059" returned: 0 in 0.532s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "cinder-quobyte-eaee4482-edf9-4ca1-b257-bc3ce8804059" released by "delete_volume" :: held 1.178s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Created reservations ['83cb93d4-c2d9-4214-86be-c587ecf0e640', 'a840b244-89c6-418e-af4c-0d9b86d62e68', '1001f35b-08a5-4398-aa9c-0999c8bbe798', '2d9fb621-fadb-425b-883e-fcfc1c79aca2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:12 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:12 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (03f52daf-9800-4a2a-8b55-574991fd69a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf1ed75-8bab-4a48-bf3f-117cf9926235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf1ed75-8bab-4a48-bf3f-117cf9926235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368788976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12810f51-77c6-4684-b83f-c6077c02e3dd,host='devstack@QuobyteHD#QuobyteHD',id=dd0f1fea-b52c-4b67-bee7-0a611e2d6342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:12Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fd7d85-460b-495a-8e94-1fdfa4418d15),volume_type_id=62fd7d85-460b-495a-8e94-1fdfa4418d15)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3bf5f8-2799-4925-971d-eea85655d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea3bf5f8-2799-4925-971d-eea85655d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7c63cc-c0b8-45f8-b47f-9d5de647e188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b7c63cc-c0b8-45f8-b47f-9d5de647e188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0f1fea-b52c-4b67-bee7-0a611e2d6342', 'volume_name': 'volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f0bda-af21-47e5-a692-5b5ef495cecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0f0bda-af21-47e5-a692-5b5ef495cecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974229c9-b5a0-4833-9a4b-9ee07c3d3b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Volume dd0f1fea-b52c-4b67-bee7-0a611e2d6342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342', 'volume_size': 1} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=12810f51-77c6-4684-b83f-c6077c02e3dd,created_at=2026-09-17T13:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368788976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=12810f51-77c6-4684-b83f-c6077c02e3dd,host='devstack@QuobyteHD#QuobyteHD',id=dd0f1fea-b52c-4b67-bee7-0a611e2d6342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:12Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62fd7d85-460b-495a-8e94-1fdfa4418d15),volume_type_id=62fd7d85-460b-495a-8e94-1fdfa4418d15)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Creating volume dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:12 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 1073741824 Sep 17 15:03:12 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:12 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Deleted volume successfully. Sep 17 15:03:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-273f0824-5ded-481c-a0ba-203621098c7e tempest-ServerRescueNegativeTestJSON-135249360 None] Lock "cinder-eaee4482-edf9-4ca1-b257-bc3ce8804059-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:13 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 1073741824" returned: 0 in 0.700s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:13 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:13 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:13 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.705s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974229c9-b5a0-4833-9a4b-9ee07c3d3b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1417ba15-628b-4803-ae31-7524938fdcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Volume volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 (dd0f1fea-b52c-4b67-bee7-0a611e2d6342): created successfully Sep 17 15:03:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1417ba15-628b-4803-ae31-7524938fdcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (03f52daf-9800-4a2a-8b55-574991fd69a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d3adede9-4a6f-452d-99f1-715e5ae1e7a1 tempest-GroupSnapshotsTest-1252094835 None] Created volume successfully. Sep 17 15:03:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] GroupSnapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: creating. Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Group snapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Creating offline snapshot 0795da53-d4af-41e9-b864-49a848fd2ec3 of volume dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e28972-d20f-49f7-9a27-700a0b5b9c56]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:15 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:15 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:16 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.774s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:16 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 1G Sep 17 15:03:16 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:17 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 1G" returned: 0 in 0.840s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:17 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:17 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:17 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.569s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:17 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:17 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:17 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:18 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:18 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info Sep 17 15:03:18 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:18 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info" returned: 0 in 0.502s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:18 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:18 devstack sudo[93330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info Sep 17 15:03:18 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:19 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.info" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.732s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f60f6ef-fb5a-43da-9789-a97378e7870f tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: created successfully Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3-31cc67b6-6535-42cb-95b1-0de1268f9c95" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3-31cc67b6-6535-42cb-95b1-0de1268f9c95" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Creating volume 31cc67b6-6535-42cb-95b1-0de1268f9c95 from snapshot 0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] snapshot: 0795da53-d4af-41e9-b864-49a848fd2ec3, volume: 31cc67b6-6535-42cb-95b1-0de1268f9c95, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc0e65c-3335-40ec-a497-228cdd4c1f34]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:20 devstack sudo[93336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:20 devstack sudo[93336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:21 devstack sudo[93336]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.476s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf90c61-7a7a-43af-a2ce-0d6dad7ef7eb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:21 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:21 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:21 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:03:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:21 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 Sep 17 15:03:21 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:30 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:30 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:INSERT=4,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:03:31 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95" returned: 0 in 9.613s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342, size 1024.00 MB, duration 9.61 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:03:31 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Converted 1024.00 MB image at 106.51 MB/s Sep 17 15:03:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:31 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 Sep 17 15:03:31 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:31 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" released by "_copy_volume_from_snapshot" :: held 11.008s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3-31cc67b6-6535-42cb-95b1-0de1268f9c95" released by "_create_volume_from_snapshot" :: held 11.101s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.125s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-15dd3ef8-9c31-449f-80b5-5b71791df0fa tempest-GroupSnapshotsTest-1252094835 None] Create group from source-snapshot-05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc completed successfully. Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c589e510-f4fc-425c-a7c9-6be864159af8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:32 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 Sep 17 15:03:32 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:32 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:32 devstack sudo[93386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95 Sep 17 15:03:32 devstack sudo[93386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:33 devstack sudo[93386]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-31cc67b6-6535-42cb-95b1-0de1268f9c95" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-31cc67b6-6535-42cb-95b1-0de1268f9c95" released by "delete_volume" :: held 0.752s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['644d8bfc-33ab-4c43-b262-81695921e2b4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-122376089 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-122376089, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:03:33 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-122376089 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-122376089, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['a7a1ad60-0668-4324-9355-3b28ae5ebcfa', '8d66a233-ad53-4093-b4c1-e57edcb5f160', '8173dab4-eee3-4337-92a2-bdf7b60dd8b8', '6debc52f-dfd1-44bd-81f4-7df8a735e14c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:33 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:33 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: deleting Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Deleting offline snapshot 0795da53-d4af-41e9-b864-49a848fd2ec3 of volume dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:03:33 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] snapshot_file for this snap is: volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9eb13-8658-4a25-aed8-3e961ec416ec]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5e6910d7-b416-4258-a968-0c317bcea596 tempest-GroupSnapshotsTest-1252094835 None] Delete group completed successfully. Sep 17 15:03:34 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:34 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:34 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:03:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f58305-a3c8-4a16-b9ef-898f0309e3bc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:34 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:34 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:35 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.590s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:35 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:35 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:35 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:35 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3 Sep 17 15:03:35 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:35 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342.0795da53-d4af-41e9-b864-49a848fd2ec3" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-0795da53-d4af-41e9-b864-49a848fd2ec3" released by "_delete_snapshot" :: held 2.043s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" released by "delete_snapshot" :: held 2.083s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:35 devstack cinder-volume[85963]: WARNING cinder.quota [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-122376089 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-122376089, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:03:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['ba6f34ec-5e72-428a-9145-b7192b9bd7ab', 'a9d75b17-d35d-41b6-b21d-fa0921e9aa06', 'f399cf74-2b59-4b93-a7c9-27bfca3e90df', 'ba3fc54e-22bf-4914-bc24-dcb22995236f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-999458dd-e644-423c-a391-1e09ad8c57ca tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 05f9a2df-e5c1-4d37-8bd7-2339b2bd96cc: deleted successfully Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Flow 'volume_create_manager' (156b60d6-ab67-430e-a681-b300d7b4e274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3f4c0d-4513-4b94-834e-4e4d2c2eaaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3f4c0d-4513-4b94-834e-4e4d2c2eaaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1928724936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b1870f-1eed-4ca2-b9f4-2fc1b661a104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621872872e7745e989ce89de35e789d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:37Z,use_quota=True,user_id='96fdd654ab924c96816449503481d5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f7d014-2fde-47f8-912b-298022be1592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f7d014-2fde-47f8-912b-298022be1592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e1e864-619b-4c96-a345-b2406714c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e1e864-619b-4c96-a345-b2406714c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b1870f-1eed-4ca2-b9f4-2fc1b661a104', 'volume_name': 'volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01428190-3e7b-430d-912b-85433ce32edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01428190-3e7b-430d-912b-85433ce32edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81b2179-cabf-48f8-a2e2-14b2758900f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume 12b1870f-1eed-4ca2-b9f4-2fc1b661a104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104', 'volume_size': 1} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1928724936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b1870f-1eed-4ca2-b9f4-2fc1b661a104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621872872e7745e989ce89de35e789d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:37Z,use_quota=True,user_id='96fdd654ab924c96816449503481d5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Creating volume 12b1870f-1eed-4ca2-b9f4-2fc1b661a104 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:37 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 1073741824 Sep 17 15:03:37 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8940ee7-56a5-4280-bcb3-45614df2fc4b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:37 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:37 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:38 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 1073741824" returned: 0 in 0.612s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:38 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 Sep 17 15:03:38 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:38 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.614s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:38 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342 Sep 17 15:03:38 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:38 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81b2179-cabf-48f8-a2e2-14b2758900f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa5b72a-65e1-46e0-8414-88c806120f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 (12b1870f-1eed-4ca2-b9f4-2fc1b661a104): created successfully Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa5b72a-65e1-46e0-8414-88c806120f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:38 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Flow 'volume_create_manager' (156b60d6-ab67-430e-a681-b300d7b4e274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-dd0f1fea-b52c-4b67-bee7-0a611e2d6342" released by "delete_volume" :: held 1.074s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5cd7103e-717a-40e2-97d4-43455fc1befc tempest-VolumeQuotasAdminTestJSON-17189443 None] Created volume successfully. Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['7a1236d5-ef64-45b4-821e-c0866e88c5bb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:38 devstack cinder-volume[85963]: WARNING cinder.db.api [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-122376089'] Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['df91558d-0982-424b-a768-fa58a59cfba9', '79024594-6454-49a4-8e12-2440dd6f43f3', '8f0fae45-273e-4792-bf4f-a863b52b2514', '335412d2-1489-411c-9925-5a76712f8338'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:38 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:38 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:39 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ee2d9c9e-1674-40e9-9799-6b5e2b35b82b tempest-GroupSnapshotsTest-1252094835 None] Delete group completed successfully. Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "cinder-12b1870f-1eed-4ca2-b9f4-2fc1b661a104-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "cinder-12b1870f-1eed-4ca2-b9f4-2fc1b661a104-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "cinder-quobyte-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "cinder-quobyte-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e20421-b052-404a-a810-a67091e9874b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:39 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 Sep 17 15:03:39 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:40 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:40 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104 Sep 17 15:03:40 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9f76ada3-4eb4-49fb-8b78-a254103f62db tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-1443803277: creating Sep 17 15:03:40 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" returned: 0 in 0.382s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9f76ada3-4eb4-49fb-8b78-a254103f62db tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-1443803277: created successfully Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "cinder-quobyte-12b1870f-1eed-4ca2-b9f4-2fc1b661a104" released by "delete_volume" :: held 0.909s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9f76ada3-4eb4-49fb-8b78-a254103f62db tempest-GroupSnapshotsTest-1252094835 None] Create group completed successfully. Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Created reservations ['fc7ea56f-ee3d-41f7-939b-fd879dd4fa99', '6c92d788-a2c6-40f9-a42a-7e37d4df21c0', 'f6aa91d1-ceb1-432b-9bbe-d0cec3f87a8c', '09f4c73f-308f-4da9-9057-151bfcc5fe90'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:40 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:40 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5d6f16e7-e99c-41e5-9a73-7722773625a2 tempest-BackendsCapabilitiesAdminTestsJSON-1536094850 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 15:03:40 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Deleted volume successfully. Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e0172d04-ed34-46ba-85bf-33b0f25bd66b tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "cinder-12b1870f-1eed-4ca2-b9f4-2fc1b661a104-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb55dcfc-25be-4f7a-80d0-02d266e771b8 tempest-BackendsCapabilitiesAdminTestsJSON-1536094850 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Flow 'volume_create_manager' (270b9c76-63a6-48bd-8272-6e725639578c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfa4601-6fb4-43fc-be01-a5197292929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfa4601-6fb4-43fc-be01-a5197292929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044559752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621872872e7745e989ce89de35e789d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:41Z,use_quota=True,user_id='96fdd654ab924c96816449503481d5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89bc846-e308-454a-a6a9-2147511d5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89bc846-e308-454a-a6a9-2147511d5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c58cc52-b983-40fd-a48a-df4571155815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c58cc52-b983-40fd-a48a-df4571155815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb', 'volume_name': 'volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0e5a07-99f9-411f-adab-1fbfaf4072f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed0e5a07-99f9-411f-adab-1fbfaf4072f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0ebd6c-41f5-41ac-9fd2-f04503e5ab47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume 77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb', 'volume_size': 1} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044559752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='621872872e7745e989ce89de35e789d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:41Z,use_quota=True,user_id='96fdd654ab924c96816449503481d5c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Creating volume 77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:41 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:41 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb 1073741824 Sep 17 15:03:41 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:42 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb 1073741824" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:42 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb Sep 17 15:03:42 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (c83774bf-51c3-4c32-b617-258b9d9f2fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5bad8-ab90-402c-82b8-b9ff861fefba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb5bad8-ab90-402c-82b8-b9ff861fefba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244172836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745392e3-7204-4b39-b32d-46000e03ee2d,host='devstack@QuobyteHD#QuobyteHD',id=4cfba23b-e0a3-45da-81ab-96d0def98b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:42Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afcc5b96-ee3d-4065-8fb8-4c3e3affd737),volume_type_id=afcc5b96-ee3d-4065-8fb8-4c3e3affd737)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b96f36-041d-405a-8d3a-c0ec6dcd6bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b96f36-041d-405a-8d3a-c0ec6dcd6bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c5a3f6-c6d1-4c10-ad54-58673c8a2863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97c5a3f6-c6d1-4c10-ad54-58673c8a2863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfba23b-e0a3-45da-81ab-96d0def98b53', 'volume_name': 'volume-4cfba23b-e0a3-45da-81ab-96d0def98b53', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62700943-d0b2-4bf8-8226-a77ba001dbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62700943-d0b2-4bf8-8226-a77ba001dbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e0234-6fbf-43e0-8863-13f0857af7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Volume 4cfba23b-e0a3-45da-81ab-96d0def98b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfba23b-e0a3-45da-81ab-96d0def98b53', 'volume_size': 1} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:42 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.036s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=745392e3-7204-4b39-b32d-46000e03ee2d,created_at=2026-09-17T13:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244172836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745392e3-7204-4b39-b32d-46000e03ee2d,host='devstack@QuobyteHD#QuobyteHD',id=4cfba23b-e0a3-45da-81ab-96d0def98b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:42Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afcc5b96-ee3d-4065-8fb8-4c3e3affd737),volume_type_id=afcc5b96-ee3d-4065-8fb8-4c3e3affd737)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Creating volume 4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:42 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0ebd6c-41f5-41ac-9fd2-f04503e5ab47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack sudo[93488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 1073741824 Sep 17 15:03:42 devstack sudo[93488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e219ce75-8bc8-4743-bf9a-56ecb79282d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Volume volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb (77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb): created successfully Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e219ce75-8bc8-4743-bf9a-56ecb79282d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Flow 'volume_create_manager' (270b9c76-63a6-48bd-8272-6e725639578c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b5900aaf-8f5f-4128-a2a5-7c950acfa08c tempest-VolumeQuotasAdminTestJSON-17189443 None] Created volume successfully. Sep 17 15:03:43 devstack sudo[93488]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 1073741824" returned: 0 in 0.555s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:43 devstack sudo[93494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 Sep 17 15:03:43 devstack sudo[93494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:43 devstack sudo[93494]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4e0234-6fbf-43e0-8863-13f0857af7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfba23b-e0a3-45da-81ab-96d0def98b53', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4409eb6-0bd3-4fc0-8a2e-308f5f0e017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Volume volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 (4cfba23b-e0a3-45da-81ab-96d0def98b53): created successfully Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4409eb6-0bd3-4fc0-8a2e-308f5f0e017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (c83774bf-51c3-4c32-b617-258b9d9f2fa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-800274fb-7e11-4855-be65-3fefd7ab7830 tempest-GroupSnapshotsTest-1252094835 None] Created volume successfully. Sep 17 15:03:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-565ab94e-ab87-4936-8cb0-e40326bcfed1 tempest-VolumeQuotasAdminTestJSON-1355816836 None] Transfer volume completed successfully. Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Acquiring lock "cinder-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "cinder-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Acquiring lock "cinder-quobyte-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "cinder-quobyte-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[58008d6c-3294-43a3-afa8-b499ce5ff752]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:45 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb Sep 17 15:03:45 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (540b1a8a-4148-4674-9a85-1b970fc6bf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6077db1-147c-492e-b2f3-bf982dfd1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6077db1-147c-492e-b2f3-bf982dfd1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132947276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745392e3-7204-4b39-b32d-46000e03ee2d,host='devstack@QuobyteHD#QuobyteHD',id=c0145631-0841-48be-b82c-57535e60d94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:46Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afcc5b96-ee3d-4065-8fb8-4c3e3affd737),volume_type_id=afcc5b96-ee3d-4065-8fb8-4c3e3affd737)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307506b9-f384-4747-bcb6-14c84c17d396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:45 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (307506b9-f384-4747-bcb6-14c84c17d396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d644b3-56cd-409d-9d29-cf6ca692a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d644b3-56cd-409d-9d29-cf6ca692a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0145631-0841-48be-b82c-57535e60d94d', 'volume_name': 'volume-c0145631-0841-48be-b82c-57535e60d94d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1f6904-b011-4174-8078-d115fc0c4150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f1f6904-b011-4174-8078-d115fc0c4150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04349bf0-cebc-4ae0-8a07-98ece6d00336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Volume c0145631-0841-48be-b82c-57535e60d94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0145631-0841-48be-b82c-57535e60d94d', 'volume_size': 1} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=745392e3-7204-4b39-b32d-46000e03ee2d,created_at=2026-09-17T13:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2132947276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=745392e3-7204-4b39-b32d-46000e03ee2d,host='devstack@QuobyteHD#QuobyteHD',id=c0145631-0841-48be-b82c-57535e60d94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:46Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afcc5b96-ee3d-4065-8fb8-4c3e3affd737),volume_type_id=afcc5b96-ee3d-4065-8fb8-4c3e3affd737)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Creating volume c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" returned: 0 in 0.494s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:45 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d 1073741824 Sep 17 15:03:45 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:45 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb Sep 17 15:03:45 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:46 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "cinder-quobyte-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb" released by "delete_volume" :: held 0.887s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Created reservations ['4a0fb422-4f2a-458b-881c-09326f65df68', 'bc29a24e-e343-410d-8c2d-e0c9370a4cab', '394b1a03-ea47-4497-85bf-cdee12390ed9', 'f947a74f-b4f9-4f0e-927d-27ad2bfb3c73'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:46 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:46 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:46 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d 1073741824" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:46 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d Sep 17 15:03:46 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:46 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Deleted volume successfully. Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7befecd3-d384-450e-9892-50b726226ee4 tempest-VolumeQuotasAdminTestJSON-2120482591 None] Lock "cinder-77e93268-0c2f-4d30-baf8-d8cf1a8fa4bb-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:03:46 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04349bf0-cebc-4ae0-8a07-98ece6d00336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0145631-0841-48be-b82c-57535e60d94d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8962bed-e7ec-436f-97ea-3dc6e4e0f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Volume volume-c0145631-0841-48be-b82c-57535e60d94d (c0145631-0841-48be-b82c-57535e60d94d): created successfully Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8962bed-e7ec-436f-97ea-3dc6e4e0f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (540b1a8a-4148-4674-9a85-1b970fc6bf55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4815b1f1-34d7-42ef-b36d-1da08ccb6431 tempest-GroupSnapshotsTest-1252094835 None] Created volume successfully. Sep 17 15:03:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-730731ef-77b3-4800-8a6e-024d7e55089d tempest-GroupSnapshotsTest-1252094835 None] Update group completed successfully. Sep 17 15:03:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9dbf24f8-0188-4bd7-aec8-386a5e219f5d tempest-GroupSnapshotsTest-1252094835 None] Update group completed successfully. Sep 17 15:03:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-08d18be9-3c55-48af-a400-7a04dc2964bd tempest-GroupSnapshotsTest-1252094835 None] Update group completed successfully. Sep 17 15:03:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c74274e2-5346-4140-8044-40c49531073f tempest-GroupSnapshotsTest-1252094835 None] Update group completed successfully. Sep 17 15:03:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] GroupSnapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: creating. Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Group snapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Creating offline snapshot 5f0f5d4f-7302-4321-9e54-5179fb23a09b of volume 4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77d6a99-420e-4b2f-bbb6-a175dfe16b18]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:54 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 Sep 17 15:03:54 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:54 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:54 devstack sudo[93529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b 1G Sep 17 15:03:54 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:55 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b 1G" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:55 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b Sep 17 15:03:55 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:55 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:55 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:55 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b Sep 17 15:03:55 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:55 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:55 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info Sep 17 15:03:55 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:56 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:56 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info Sep 17 15:03:56 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:56 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.info" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Creating offline snapshot 7f975902-d085-4889-b445-491676e9dbd5 of volume c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56f24b3-a695-48c0-a775-095dd45e5494]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:56 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d Sep 17 15:03:56 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:56 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d" returned: 0 in 0.479s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:56 devstack sudo[93554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:03:56 devstack sudo[93554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:56 devstack sudo[93555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 1G Sep 17 15:03:56 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:57 devstack sudo[93554]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Flow 'volume_create_manager' (1da64216-6779-4792-86b7-5be131e13689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c88d58-76c2-4443-8346-633d4a5caba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c88d58-76c2-4443-8346-633d4a5caba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1716715318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f27f6a-23a8-45f5-b715-6f5f146ef0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6297bbb0e082453ea3a2f01e73f65aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:57Z,use_quota=True,user_id='74d44e5c44bc41ef95a479031573ed00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77bb220-8d74-4ac3-854d-f8b3dcccce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77bb220-8d74-4ac3-854d-f8b3dcccce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c322de1-0203-4777-b0db-1c187e41d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Flow 'volume_create_manager' (4a77aaaf-2ffb-4684-b85b-193a036f6eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b309b0-7491-4d96-82bc-a7791ac74d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b309b0-7491-4d96-82bc-a7791ac74d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-642013471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b441818b-b74f-44fd-bec1-42de72acba6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883683c678144b598570799199be941a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:57Z,use_quota=True,user_id='aac8268cb71640488a7c53dd15dc0c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad32c65b-78e4-4bdc-887b-ee42546d97df),volume_type_id=ad32c65b-78e4-4bdc-887b-ee42546d97df)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76371674-5510-4087-94c8-8f4622d04f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76371674-5510-4087-94c8-8f4622d04f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ea15ef-1a8c-4ddb-8186-a3c5678a6efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ea15ef-1a8c-4ddb-8186-a3c5678a6efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b441818b-b74f-44fd-bec1-42de72acba6b', 'volume_name': 'volume-b441818b-b74f-44fd-bec1-42de72acba6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7a8294-f77d-404b-a8ef-7cf2697d0e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c7a8294-f77d-404b-a8ef-7cf2697d0e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4876f1a3-6ae8-4a13-9647-00cde7690cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Volume b441818b-b74f-44fd-bec1-42de72acba6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b441818b-b74f-44fd-bec1-42de72acba6b', 'volume_size': 1} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 1G" returned: 0 in 0.643s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0145631-0841-48be-b82c-57535e60d94d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:57 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0145631-0841-48be-b82c-57535e60d94d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 Sep 17 15:03:57 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c322de1-0203-4777-b0db-1c187e41d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '10f27f6a-23a8-45f5-b715-6f5f146ef0f4', 'volume_name': 'volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc402552-3e6d-4847-a5dc-753dbfa8b3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc402552-3e6d-4847-a5dc-753dbfa8b3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b895c39d-7f0a-401b-ae63-1c3d2c444458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Trying to clone 10f27f6a-23a8-45f5-b715-6f5f146ef0f4 from image 8d02878c-b12d-4421-bc53-544f1bf812dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:03:57 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0145631-0841-48be-b82c-57535e60d94d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:57 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:57 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 Sep 17 15:03:57 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:03:58 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5" returned: 0 in 0.337s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce72809-12b7-416b-b465-6e4aba896ced]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:58 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info Sep 17 15:03:58 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d4f81ecc-85a0-457a-987f-bebbe5a9ca30 tempest-GroupsV320Test-2005080536 None] Group tempest-GroupsV320Test-Group-611553247: creating Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d4f81ecc-85a0-457a-987f-bebbe5a9ca30 tempest-GroupsV320Test-2005080536 None] Group tempest-GroupsV320Test-Group-611553247: created successfully Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d4f81ecc-85a0-457a-987f-bebbe5a9ca30 tempest-GroupsV320Test-2005080536 None] Create group completed successfully. Sep 17 15:03:58 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD Sep 17 15:03:58 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:58 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:58 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info Sep 17 15:03:58 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd is fetched for user 74d44e5c44bc41ef95a479031573ed00. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[171ddf40-a92b-4549-99dd-36003229b697]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:58 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.info" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:58 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD Sep 17 15:03:58 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-642013471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b441818b-b74f-44fd-bec1-42de72acba6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='883683c678144b598570799199be941a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:57Z,use_quota=True,user_id='aac8268cb71640488a7c53dd15dc0c62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ad32c65b-78e4-4bdc-887b-ee42546d97df),volume_type_id=ad32c65b-78e4-4bdc-887b-ee42546d97df)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Creating volume b441818b-b74f-44fd-bec1-42de72acba6b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:58 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b 1073741824 Sep 17 15:03:58 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eebb7ac4-ed57-4a12-ba0c-b5e0f220b80b tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: created successfully Sep 17 15:03:59 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:59 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b 1073741824" returned: 0 in 0.460s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:59 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b Sep 17 15:03:59 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: deleting Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:59 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-5f0f5d4f-7302-4321-9e54-5179fb23a09b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.612s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1716715318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f27f6a-23a8-45f5-b715-6f5f146ef0f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6297bbb0e082453ea3a2f01e73f65aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:03:57Z,use_quota=True,user_id='74d44e5c44bc41ef95a479031573ed00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Creating volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:03:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-5f0f5d4f-7302-4321-9e54-5179fb23a09b" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Deleting offline snapshot 5f0f5d4f-7302-4321-9e54-5179fb23a09b of volume 4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:03:59 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1073741824 Sep 17 15:03:59 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] snapshot_file for this snap is: volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4876f1a3-6ae8-4a13-9647-00cde7690cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b441818b-b74f-44fd-bec1-42de72acba6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389587fa-aaf9-496e-b6c0-6e25ffe2c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[623555f8-3e11-40ed-bce9-f0408af61984]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:03:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Volume volume-b441818b-b74f-44fd-bec1-42de72acba6b (b441818b-b74f-44fd-bec1-42de72acba6b): created successfully Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389587fa-aaf9-496e-b6c0-6e25ffe2c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Flow 'volume_create_manager' (4a77aaaf-2ffb-4684-b85b-193a036f6eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:03:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0e562cfe-9c30-42ae-a4f8-70daf10bc2a9 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Created volume successfully. Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Created reservations ['152a0833-ee2c-409b-a3f7-6e7337e90c9c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:03:59 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b Sep 17 15:03:59 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:03:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:00 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:00 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1073741824" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:00 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cfba23b-e0a3-45da-81ab-96d0def98b53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:00 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 Sep 17 15:04:00 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-21025852-0358-4b4a-b807-fcd5bcced3d8 tempest-GroupsV320Test-2005080536 None] Delete group completed successfully. Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad0b346-c2ab-4976-8d53-d1440063c366]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 Sep 17 15:04:00 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:00 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Attempting download of 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c3a8ab-9e79-4499-9f97-8d6902400948]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy Sep 17 15:04:00 devstack sudo[93618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:00 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b Sep 17 15:04:00 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:00 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:00 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:01 devstack sudo[93618]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy" returned: 0 in 0.462s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:01 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e92f9349-e5de-420d-9d33-0e03ac7b6ce7 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Retype volume completed successfully. Sep 17 15:04:01 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:01 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy Sep 17 15:04:01 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:01 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b Sep 17 15:04:01 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:01 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy" returned: 1 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_v3jt8hdy' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[706117c1-b5c6-480c-8220-e573b9e2cc4b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:01 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53.5f0f5d4f-7302-4321-9e54-5179fb23a09b" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-5f0f5d4f-7302-4321-9e54-5179fb23a09b" released by "_delete_snapshot" :: held 1.815s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" released by "delete_snapshot" :: held 1.886s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-7f975902-d085-4889-b445-491676e9dbd5" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-7f975902-d085-4889-b445-491676e9dbd5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Deleting offline snapshot 7f975902-d085-4889-b445-491676e9dbd5 of volume c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:01 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD Sep 17 15:04:01 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] snapshot_file for this snap is: volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c02e3c-e144-4b2b-b8a8-be43c6a95116]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:01 devstack sudo[93644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 Sep 17 15:04:01 devstack sudo[93644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:01 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] 8d02878c-b12d-4421-bc53-544f1bf812dd was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:04:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:01 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 Sep 17 15:04:01 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:02 devstack sudo[93644]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0145631-0841-48be-b82c-57535e60d94d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e3bcd-f49f-464f-b8ad-b68067199f20]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "cinder-b441818b-b74f-44fd-bec1-42de72acba6b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "cinder-b441818b-b74f-44fd-bec1-42de72acba6b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:02 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d Sep 17 15:04:02 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "cinder-quobyte-b441818b-b74f-44fd-bec1-42de72acba6b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "cinder-quobyte-b441818b-b74f-44fd-bec1-42de72acba6b" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1737ab6c-8ad9-493a-8f9e-ec1334fa986e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:02 devstack sudo[93663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b Sep 17 15:04:02 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:02 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d" returned: 0 in 0.601s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:02 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 Sep 17 15:04:02 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:03 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b" returned: 0 in 0.622s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:03 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b Sep 17 15:04:03 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:03 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5" returned: 0 in 0.574s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:03 devstack sudo[93681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5 Sep 17 15:04:03 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:03 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b441818b-b74f-44fd-bec1-42de72acba6b" returned: 0 in 0.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "cinder-quobyte-b441818b-b74f-44fd-bec1-42de72acba6b" released by "delete_volume" :: held 1.186s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:03 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:03 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Created reservations ['831bc49d-9a50-47db-9b87-4d952d9b0fd7', '919e91f8-8d31-4ed4-bb9c-fa79e35336fa', '682ea73b-02f8-4746-ab05-a79642a01b33', 'bbba3baf-826a-4572-987b-602948cb2579'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:03 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d.7f975902-d085-4889-b445-491676e9dbd5" returned: 0 in 0.475s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:03 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:03 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-7f975902-d085-4889-b445-491676e9dbd5" released by "_delete_snapshot" :: held 2.249s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" released by "delete_snapshot" :: held 2.278s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:03 devstack cinder-volume[85963]: WARNING cinder.quota [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-816017014 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-816017014, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:03 devstack cinder-volume[85963]: WARNING cinder.quota [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-816017014 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-816017014, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['bbfcd06d-bdac-4faf-853e-23a97cc552c5', '5e5edb72-29fc-4c59-afc0-f4ca35b91972', '1b4e2288-2320-4ae1-b654-a2842c446af9', '4edb2d2f-abac-436c-96a3-561fd06aa7d0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['3a1ad2a1-a4c2-4dac-8528-968c046ef277', '94b8ee0a-fc11-4787-8118-2e9a5c07bcfd', '8b5b9559-e4ab-4280-a503-5637cfc30283', 'faa20700-d3a9-4482-b219-89cbb28623a6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:04 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Deleted volume successfully. Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4dc557c-e9e8-4720-983c-5bb33261fe27 tempest-VolumeRetypeWithoutMigrationTest-1452070637 None] Lock "cinder-b441818b-b74f-44fd-bec1-42de72acba6b-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2bafdbe9-47fa-48e6-b6ae-e30a8e585d1c tempest-GroupSnapshotsTest-1252094835 None] group_snapshot 09244b7c-8fe7-45a6-8632-79af421c96ac: deleted successfully Sep 17 15:04:04 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" returned: 0 in 2.563s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_efjm9jubdevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:04:04 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Converted 112.00 MB image at 43.68 MB/s Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:04 devstack sudo[93690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1G Sep 17 15:04:04 devstack sudo[93690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:04 devstack sudo[93690]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 1G" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Downloaded image 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd for user 74d44e5c44bc41ef95a479031573ed00 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Marking volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Copying metadata from image 8d02878c-b12d-4421-bc53-544f1bf812dd to 10f27f6a-23a8-45f5-b715-6f5f146ef0f4. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Creating volume glance metadata for volume 10f27f6a-23a8-45f5-b715-6f5f146ef0f4 backed by image 8d02878c-b12d-4421-bc53-544f1bf812dd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:04:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b895c39d-7f0a-401b-ae63-1c3d2c444458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7484deb-4b6b-4f2c-9495-4680ed8fde16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Volume volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 (10f27f6a-23a8-45f5-b715-6f5f146ef0f4): created successfully Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7484deb-4b6b-4f2c-9495-4680ed8fde16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Flow 'volume_create_manager' (1da64216-6779-4792-86b7-5be131e13689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a6e68259-ef5b-49be-a5ab-6b9d48061eb2 tempest-VolumesExtendTest-110191599 None] Created volume successfully. Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc7166e-41bf-4e61-b175-f27fe29f2c64]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:05 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 Sep 17 15:04:05 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f278f269-7301-4f6d-af52-a89a427aac38]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:06 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 Sep 17 15:04:06 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:06 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:06 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53 Sep 17 15:04:06 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:06 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:06 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4cfba23b-e0a3-45da-81ab-96d0def98b53" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-4cfba23b-e0a3-45da-81ab-96d0def98b53" released by "delete_volume" :: held 0.876s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 2G" returned: 0 in 0.149s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.681s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece13553-747c-4f62-acac-ce4b5ca22dda]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8ff4d35f-f28f-439b-b074-6f952fac6647 tempest-VolumesExtendTest-110191599 None] Extend volume completed successfully. Sep 17 15:04:06 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d Sep 17 15:04:06 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:07 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:07 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d Sep 17 15:04:07 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:07 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c0145631-0841-48be-b82c-57535e60d94d" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-c0145631-0841-48be-b82c-57535e60d94d" released by "delete_volume" :: held 0.927s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-10f27f6a-23a8-45f5-b715-6f5f146ef0f4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['8dfee766-d6f8-4ee5-9c9b-8d161dac8c6a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "cinder-10f27f6a-23a8-45f5-b715-6f5f146ef0f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:07 devstack cinder-volume[85963]: WARNING cinder.quota [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-816017014 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-816017014, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-quobyte-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d5a8a-8e32-4415-9a1f-dc44f0b561af]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['0477e099-8820-4316-aa20-30f551136b38', 'd3b53c44-af25-4bc1-b5eb-3a6885f0e306', '56d131bf-e318-440a-b0d2-610db89723ed', 'ba414cd1-abe6-4a40-bd22-d20d691805e6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:07 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 Sep 17 15:04:07 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['f0a44295-adb8-425f-8753-c826772b636c', '8eb2175e-c5a3-476e-9a5f-774ff3e7275b', '2c3bea6d-0a6c-4cdb-810d-7564a4d38ee7', 'a70b84dd-e6de-4b2b-8dd7-d338a8d0eea1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:08 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:08 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:08 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:08 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4 Sep 17 15:04:08 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:08 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b0d84cb4-f5ba-4122-8249-c637055e0bb4 tempest-GroupSnapshotsTest-1252094835 None] Delete group completed successfully. Sep 17 15:04:08 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-10f27f6a-23a8-45f5-b715-6f5f146ef0f4" released by "delete_volume" :: held 1.010s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Created reservations ['8394e0a1-cc6e-461d-8ea4-0d6175072f19', '62d13329-05e1-4f92-adf7-cfbf8636e2ca', '706094ea-008e-4346-9b5d-809656e42eb6', 'e3630e2b-0f81-4272-a525-0b0d0097a999'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-09228cdc-e765-47c6-a0a3-5a434bc5c257 tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-499133183: creating Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-09228cdc-e765-47c6-a0a3-5a434bc5c257 tempest-GroupSnapshotsTest-1252094835 None] Group tempest-GroupSnapshotsTest-Group-499133183: created successfully Sep 17 15:04:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-09228cdc-e765-47c6-a0a3-5a434bc5c257 tempest-GroupSnapshotsTest-1252094835 None] Create group completed successfully. Sep 17 15:04:09 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:09 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:09 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.262s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Deleted volume successfully. Sep 17 15:04:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7de5742f-6aa6-47b3-bd45-f29330405e6c tempest-VolumesExtendTest-110191599 None] Lock "cinder-10f27f6a-23a8-45f5-b715-6f5f146ef0f4-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Flow 'volume_create_manager' (b42d8cc7-2ef3-485c-8d27-5a437018a57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1436ef3b-b6c7-4aa1-a60d-a9ba45304913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1436ef3b-b6c7-4aa1-a60d-a9ba45304913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-923603219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6297bbb0e082453ea3a2f01e73f65aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:10Z,use_quota=True,user_id='74d44e5c44bc41ef95a479031573ed00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54272184-9db2-44c4-9fdc-a48147fe7179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54272184-9db2-44c4-9fdc-a48147fe7179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8c01f9-92f1-49f4-8f9f-876ce374e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be8c01f9-92f1-49f4-8f9f-876ce374e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b', 'volume_name': 'volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083efa11-916b-424c-a265-6e28d269963b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083efa11-916b-424c-a265-6e28d269963b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7addf9e3-0d9a-4265-8d7c-d70f72325eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Volume 5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b', 'volume_size': 1} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-923603219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6297bbb0e082453ea3a2f01e73f65aa0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:10Z,use_quota=True,user_id='74d44e5c44bc41ef95a479031573ed00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Creating volume 5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:10 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:10 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b 1073741824 Sep 17 15:04:10 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (432202de-8350-4257-97bf-b9e059388d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bdbd9b-84b1-4d27-be78-6a198201fb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83bdbd9b-84b1-4d27-be78-6a198201fb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80907383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebca8ce-5643-4979-a1a8-9e39d415ad45,host='devstack@QuobyteHD#QuobyteHD',id=a51545d6-8f4c-491b-a652-52f9e09daac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:11Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(904a27d9-42be-4a75-887d-3d501e8eca32),volume_type_id=904a27d9-42be-4a75-887d-3d501e8eca32)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe380a0-fc37-4ac1-ad7f-187a3cd35945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fe380a0-fc37-4ac1-ad7f-187a3cd35945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159d0b22-2841-40b4-bfd7-cc7829f4e009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (159d0b22-2841-40b4-bfd7-cc7829f4e009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51545d6-8f4c-491b-a652-52f9e09daac8', 'volume_name': 'volume-a51545d6-8f4c-491b-a652-52f9e09daac8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee388061-a140-4a2c-a6ef-a03543679d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee388061-a140-4a2c-a6ef-a03543679d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea6b58e-8014-4fcd-8936-f2f156aab45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Volume a51545d6-8f4c-491b-a652-52f9e09daac8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51545d6-8f4c-491b-a652-52f9e09daac8', 'volume_size': 1} Sep 17 15:04:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:11 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b 1073741824" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:11 devstack sudo[93746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:11 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:11 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.751s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cebca8ce-5643-4979-a1a8-9e39d415ad45,created_at=2026-09-17T13:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-80907383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cebca8ce-5643-4979-a1a8-9e39d415ad45,host='devstack@QuobyteHD#QuobyteHD',id=a51545d6-8f4c-491b-a652-52f9e09daac8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6bbfbd86058450492645e1a526d911e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:11Z,use_quota=True,user_id='19b6044231584106b09e1dc8db76dd54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(904a27d9-42be-4a75-887d-3d501e8eca32),volume_type_id=904a27d9-42be-4a75-887d-3d501e8eca32)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Creating volume a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:11 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7addf9e3-0d9a-4265-8d7c-d70f72325eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd2531-13f5-472d-a0a1-941670149b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:11 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 1073741824 Sep 17 15:04:11 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Volume volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b (5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b): created successfully Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66dd2531-13f5-472d-a0a1-941670149b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Flow 'volume_create_manager' (b42d8cc7-2ef3-485c-8d27-5a437018a57b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d2758b7d-2029-4318-b5cc-3d420a990ac6 tempest-VolumesExtendTest-110191599 None] Created volume successfully. Sep 17 15:04:12 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 1073741824" returned: 0 in 0.569s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:12 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 Sep 17 15:04:12 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:12 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea6b58e-8014-4fcd-8936-f2f156aab45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51545d6-8f4c-491b-a652-52f9e09daac8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f33fa-57bd-483f-983e-88a7f18d29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Volume volume-a51545d6-8f4c-491b-a652-52f9e09daac8 (a51545d6-8f4c-491b-a652-52f9e09daac8): created successfully Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7f33fa-57bd-483f-983e-88a7f18d29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Flow 'volume_create_manager' (432202de-8350-4257-97bf-b9e059388d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6a6640b9-d116-43f7-917f-9a9434d82800 tempest-GroupSnapshotsTest-1252094835 None] Created volume successfully. Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Creating offline snapshot dac4de13-48dc-4c0a-842a-4f592cfd2402 of volume 5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a83ea7c-2328-4f01-82fa-0f532913eab6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:12 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:12 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:13 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:13 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 1G Sep 17 15:04:13 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] GroupSnapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: creating. Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Group snapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: creating. {{(pid=85963) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:13 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 1G" returned: 0 in 0.502s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:13 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 Sep 17 15:04:13 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:14 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:14 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 is being set with open permissions: ugo+rw Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:14 devstack sudo[93773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 Sep 17 15:04:14 devstack sudo[93773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:14 devstack sudo[93773]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:14 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info Sep 17 15:04:14 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:14 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:14 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info is being set with open permissions: ugo+rw Sep 17 15:04:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:14 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info Sep 17 15:04:14 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:15 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.info" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.459s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Creating offline snapshot decbad4d-2805-4a02-a152-10dbfbf452de of volume a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4422fad5-745a-47a5-b5a5-59bd8c87c0e6 tempest-VolumesExtendTest-110191599 None] Create snapshot completed successfully Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[db331a97-3706-4153-a248-f5d75ce87835]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:15 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 Sep 17 15:04:15 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:15 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:15 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de 1G Sep 17 15:04:15 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:16 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de 1G" returned: 0 in 0.588s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51545d6-8f4c-491b-a652-52f9e09daac8 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:16 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51545d6-8f4c-491b-a652-52f9e09daac8 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de Sep 17 15:04:16 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Flow 'volume_create_manager' (9439cd4c-781a-480a-818d-438b3ef45105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfd530e-ee24-42b9-926f-d9e3cfb6ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cfd530e-ee24-42b9-926f-d9e3cfb6ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1302836919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eabe8ec-45f6-4802-af28-5dc060ba70c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c41506d1e25458ca39a8ade18d1f33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:16Z,use_quota=True,user_id='29726128e3ed486ab349b56c99dc35b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47caa622-9ca8-4193-b8c9-e2d8ff102da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47caa622-9ca8-4193-b8c9-e2d8ff102da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95192f12-2470-4499-a2b1-af99c5a93696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95192f12-2470-4499-a2b1-af99c5a93696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eabe8ec-45f6-4802-af28-5dc060ba70c7', 'volume_name': 'volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aadc3a6-7737-4772-bca5-1935e42244ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aadc3a6-7737-4772-bca5-1935e42244ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c867267-4dfc-4cc4-b735-d22fd2211327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Volume 9eabe8ec-45f6-4802-af28-5dc060ba70c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7', 'volume_size': 1} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:16 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a51545d6-8f4c-491b-a652-52f9e09daac8 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:16 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:16 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de Sep 17 15:04:16 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:16 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:16 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info Sep 17 15:04:16 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:17 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:17 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:17 devstack sudo[93803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info Sep 17 15:04:17 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:17 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.info" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.309s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9cb481-68de-440b-9a5a-f1c69c31af15]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6026d044-e9db-4459-9205-49e92d33d537 tempest-GroupSnapshotsTest-1252094835 None] group_snapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: created successfully Sep 17 15:04:17 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:17 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:17 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] group_snapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: deleting Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] group_snapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: deleting {{(pid=85963) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 2G" returned: 0 in 0.185s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.651s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.575s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1302836919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eabe8ec-45f6-4802-af28-5dc060ba70c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c41506d1e25458ca39a8ade18d1f33d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:16Z,use_quota=True,user_id='29726128e3ed486ab349b56c99dc35b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Creating volume 9eabe8ec-45f6-4802-af28-5dc060ba70c7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 1073741824 Sep 17 15:04:18 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-decbad4d-2805-4a02-a152-10dbfbf452de" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-decbad4d-2805-4a02-a152-10dbfbf452de" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Deleting offline snapshot decbad4d-2805-4a02-a152-10dbfbf452de of volume a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] snapshot_file for this snap is: volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fadf59a5-7569-4217-9d1a-9ef9daf96a3c tempest-VolumesExtendTest-110191599 None] Extend volume completed successfully. Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdafd6ec-b9e9-43e8-bb1d-32cd6d732682]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de Sep 17 15:04:18 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-dac4de13-48dc-4c0a-842a-4f592cfd2402-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-dac4de13-48dc-4c0a-842a-4f592cfd2402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-quobyte-dac4de13-48dc-4c0a-842a-4f592cfd2402" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-dac4de13-48dc-4c0a-842a-4f592cfd2402" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Deleting offline snapshot dac4de13-48dc-4c0a-842a-4f592cfd2402 of volume 5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] snapshot_file for this snap is: volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d5e3c0-4920-4473-9181-af54b3853fd9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a51545d6-8f4c-491b-a652-52f9e09daac8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:18 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 1073741824" returned: 0 in 0.651s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b68bee-de82-4ce1-acb9-f2af7df1e9dc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack sudo[93824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 Sep 17 15:04:18 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:18 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 Sep 17 15:04:18 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:18 devstack sudo[93828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 Sep 17 15:04:18 devstack sudo[93828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402" returned: 0 in 0.473s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:19 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[da387691-c4de-42b3-b13b-01a958609f2a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c867267-4dfc-4cc4-b735-d22fd2211327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31c6867-3a9e-4304-8ce6-47abb811a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Volume volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 (9eabe8ec-45f6-4802-af28-5dc060ba70c7): created successfully Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d31c6867-3a9e-4304-8ce6-47abb811a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Flow 'volume_create_manager' (9439cd4c-781a-480a-818d-438b3ef45105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a4c2133d-5280-401a-a4da-270a81979e7d tempest-VolumesServicesTestJSON-1705854669 None] Created volume successfully. Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (399d8c44-531c-4f72-8fa0-3fc26507bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:19 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:19 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a45a15-543b-4186-83fe-1f3a6d451682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack sudo[93828]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a45a15-543b-4186-83fe-1f3a6d451682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167887873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33703b-a8b5-4baa-ba88-11f3a0423582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94bdf4e614d9d882756cbb9d689e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:19Z,use_quota=True,user_id='4dcf57d6d84a4fc8b3426589d85af5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39131e28-b43a-48ae-ab99-b2d25063e931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de Sep 17 15:04:19 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39131e28-b43a-48ae-ab99-b2d25063e931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950227b1-ffa2-4eaa-8a75-0e36911d69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950227b1-ffa2-4eaa-8a75-0e36911d69c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf33703b-a8b5-4baa-ba88-11f3a0423582', 'volume_name': 'volume-bf33703b-a8b5-4baa-ba88-11f3a0423582', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb9956-a266-44ba-aa7e-7f24b3dd5ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcb9956-a266-44ba-aa7e-7f24b3dd5ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24eb272-63ad-41e2-a012-98b032b594d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Volume bf33703b-a8b5-4baa-ba88-11f3a0423582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf33703b-a8b5-4baa-ba88-11f3a0423582', 'volume_size': 1} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167887873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf33703b-a8b5-4baa-ba88-11f3a0423582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94bdf4e614d9d882756cbb9d689e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:19Z,use_quota=True,user_id='4dcf57d6d84a4fc8b3426589d85af5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Creating volume bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 1073741824 Sep 17 15:04:19 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 Sep 17 15:04:19 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de Sep 17 15:04:19 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Acquiring lock "cinder-9eabe8ec-45f6-4802-af28-5dc060ba70c7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "cinder-9eabe8ec-45f6-4802-af28-5dc060ba70c7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Acquiring lock "cinder-quobyte-9eabe8ec-45f6-4802-af28-5dc060ba70c7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "cinder-quobyte-9eabe8ec-45f6-4802-af28-5dc060ba70c7" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4ef442-8105-4b63-af3b-b045dca45fed]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 1073741824" returned: 0 in 0.602s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:19 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 Sep 17 15:04:19 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 Sep 17 15:04:20 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402" returned: 0 in 0.478s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:20 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8.decbad4d-2805-4a02-a152-10dbfbf452de" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402 Sep 17 15:04:20 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-decbad4d-2805-4a02-a152-10dbfbf452de" released by "_delete_snapshot" :: held 1.978s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" released by "delete_snapshot" :: held 2.022s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[85963]: WARNING cinder.quota [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1768097550 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1768097550, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:20 devstack cinder-volume[85963]: WARNING cinder.quota [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1768097550 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1768097550, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['6e64a8c3-654d-48ac-820b-1b0a6f4a6863', '9027a1c8-1a7c-4b23-81db-a8517f6e0b96', 'aedc28a4-6ba0-4937-9945-246503dbae19', 'f6746cbc-1b63-4157-a9eb-a02e2edea7cb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:20 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24eb272-63ad-41e2-a012-98b032b594d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf33703b-a8b5-4baa-ba88-11f3a0423582', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a750d3a-6ba2-4b9e-8c9f-9644e9f0d3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:20 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Volume volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 (bf33703b-a8b5-4baa-ba88-11f3a0423582): created successfully Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a750d3a-6ba2-4b9e-8c9f-9644e9f0d3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (399d8c44-531c-4f72-8fa0-3fc26507bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b.dac4de13-48dc-4c0a-842a-4f592cfd2402" returned: 0 in 0.342s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:20 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7 Sep 17 15:04:20 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e0fc3028-fe19-4422-8204-321557b3d61f tempest-VolumesDeleteCascade-274568745 None] Created volume successfully. Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-dac4de13-48dc-4c0a-842a-4f592cfd2402" released by "_delete_snapshot" :: held 1.897s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" released by "delete_snapshot" :: held 1.927s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f1da9e3d-1509-444c-b300-05154eda487d tempest-GroupSnapshotsTest-1252094835 None] group_snapshot ee4b66d4-d000-404c-bc4e-7f4395c77d34: deleted successfully Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Created reservations ['a460e410-1af9-43a9-a4a2-1f7997a45197', 'ba91808e-4a0b-4533-8875-a6e1c422022a', '4366764b-569b-43ff-b6f6-e3e65578251b', '2dfe8021-d574-458b-8d22-1e14a6cfddfc'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Delete snapshot completed successfully. Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-64a437c6-983b-4d1f-a37b-a641559c21ef tempest-VolumesExtendTest-110191599 None] Lock "cinder-dac4de13-48dc-4c0a-842a-4f592cfd2402-delete_snapshot" released by "delete_snapshot" :: held 2.067s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9eabe8ec-45f6-4802-af28-5dc060ba70c7" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "cinder-quobyte-9eabe8ec-45f6-4802-af28-5dc060ba70c7" released by "delete_volume" :: held 0.823s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Created reservations ['32f7b705-52f5-4008-9f2d-139caea20296', '0db14a97-5a54-4e89-97f5-5bd74506fe9e', '6b10e7fd-1cd2-4365-9a94-24b0c49b4eef', 'a25b3efb-f65e-44b5-848d-3a9ab3fbac97'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "cinder-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Acquiring lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[58109e3b-fcb2-4298-98c9-9bd0507046f6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:20 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:20 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:20 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:20 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:21 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Deleted volume successfully. Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-085f07f1-40ee-4ea9-84f9-4b1e67d67fc5 tempest-VolumesServicesTestJSON-1705854669 None] Lock "cinder-9eabe8ec-45f6-4802-af28-5dc060ba70c7-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:21 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:21 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b Sep 17 15:04:21 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Creating offline snapshot 900828c6-cd76-4495-b7a5-e3d5d0de37ed of volume bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:21 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae37c2b8-4cb4-43a8-b813-374fc3a0a514]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "cinder-quobyte-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b" released by "delete_volume" :: held 0.878s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Created reservations ['ba58c3b7-55ad-47b5-bc72-51ed0a3645d0', '18424346-045c-41c4-965c-b3d8cc7a213f', '0cab0d21-1c01-49dd-b906-76573a535298', 'e45091de-dc25-4d63-b486-147893947cb7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:21 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 Sep 17 15:04:21 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[932342f7-8211-445b-8b5a-5194124b09b1]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:22 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:22 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:22 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 Sep 17 15:04:22 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:22 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582" returned: 0 in 0.481s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:22 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed 1G Sep 17 15:04:22 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:22 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Deleted volume successfully. Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7f1a86d9-ae78-4f61-aa9a-2923f7b74b84 tempest-VolumesExtendTest-110191599 None] Lock "cinder-5e6a303a-aa49-4bbb-bc73-e5ea5ec8108b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:22 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:22 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8 Sep 17 15:04:22 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:22 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed 1G" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:22 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:22 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:22 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a51545d6-8f4c-491b-a652-52f9e09daac8" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Lock "cinder-quobyte-a51545d6-8f4c-491b-a652-52f9e09daac8" released by "delete_volume" :: held 0.905s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['c39f2664-6886-4e3b-a1be-387662db663f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:22 devstack cinder-volume[85963]: WARNING cinder.quota [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1768097550 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1768097550, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Created reservations ['709d88b4-67fc-451f-acae-0fa1a686db40', '67ac9b20-baa5-4217-a51e-15d5f7af74ff', 'e57ccefd-2061-49fd-96fd-fa1b2faef802', 'f8e45c83-b8ed-49d0-9ff8-22282ca021d9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:23 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed is being set with open permissions: ugo+rw Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:23 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:23 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:23 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:23 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:23 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5a87acb2-7b71-4787-afff-6bb557f58e35 tempest-GroupSnapshotsTest-1252094835 None] Delete group completed successfully. Sep 17 15:04:23 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:23 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info Sep 17 15:04:23 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:23 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info" returned: 0 in 0.293s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info is being set with open permissions: ugo+rw Sep 17 15:04:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:23 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info Sep 17 15:04:23 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:24 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.info" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6e2e1b98-4f60-45f6-b709-9662f92389c4 tempest-VolumesDeleteCascade-274568745 None] Create snapshot completed successfully Sep 17 15:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Creating offline snapshot 34547cd4-9aa7-4eac-b261-8216a8cdf477 of volume bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce802c73-40b8-47ce-a7c1-226370ea4568]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:25 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:25 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf33703b-a8b5-4baa-ba88-11f3a0423582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:25 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 1G Sep 17 15:04:25 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:26 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 1G" returned: 0 in 0.581s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:26 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 Sep 17 15:04:26 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:26 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:26 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 is being set with open permissions: ugo+rw Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:26 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 Sep 17 15:04:26 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:26 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477" returned: 0 in 0.331s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-579fbb2b-17da-4ce4-93dc-3a422cb02497 tempest-VolumesDeleteCascade-274568745 None] Create snapshot completed successfully Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-bf33703b-a8b5-4baa-ba88-11f3a0423582-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-bf33703b-a8b5-4baa-ba88-11f3a0423582-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Performing cascade delete. {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-34547cd4-9aa7-4eac-b261-8216a8cdf477-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-34547cd4-9aa7-4eac-b261-8216a8cdf477-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-34547cd4-9aa7-4eac-b261-8216a8cdf477" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-34547cd4-9aa7-4eac-b261-8216a8cdf477" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Deleting offline snapshot 34547cd4-9aa7-4eac-b261-8216a8cdf477 of volume bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] snapshot_file for this snap is: volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5f29fd-f588-4f8d-b34a-451d4c6d4b36]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:27 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 Sep 17 15:04:27 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:27 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477" returned: 0 in 0.475s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf33703b-a8b5-4baa-ba88-11f3a0423582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3853d420-7a4e-405c-bed6-743bec02a08d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:28 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (06212e70-c559-4c4d-9376-83aaf6087ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417eef46-4020-48fd-91e2-6f2870061c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417eef46-4020-48fd-91e2-6f2870061c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-846813264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92263388-89c5-4410-a536-90ba3001ffa3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:28Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643c9779-86e2-4132-8223-ef8d986451c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643c9779-86e2-4132-8223-ef8d986451c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c81a7a-dddd-4296-aff2-4e6a9fdf952f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c81a7a-dddd-4296-aff2-4e6a9fdf952f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92263388-89c5-4410-a536-90ba3001ffa3', 'volume_name': 'volume-92263388-89c5-4410-a536-90ba3001ffa3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfea8b1f-d939-43df-8959-fa10f4635881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfea8b1f-d939-43df-8959-fa10f4635881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2e2dbb-a0b7-4d71-9a33-076c22144bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Volume 92263388-89c5-4410-a536-90ba3001ffa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92263388-89c5-4410-a536-90ba3001ffa3', 'volume_size': 1} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-846813264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92263388-89c5-4410-a536-90ba3001ffa3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:28Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Creating volume 92263388-89c5-4410-a536-90ba3001ffa3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 1073741824 Sep 17 15:04:28 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:28 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.572s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf33703b-a8b5-4baa-ba88-11f3a0423582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:28 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 Sep 17 15:04:28 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:28 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 1073741824" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477 Sep 17 15:04:29 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 Sep 17 15:04:29 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3" returned: 0 in 0.361s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:29 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.34547cd4-9aa7-4eac-b261-8216a8cdf477" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2e2dbb-a0b7-4d71-9a33-076c22144bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92263388-89c5-4410-a536-90ba3001ffa3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6a0cea-4874-459a-a5c3-95336f42cda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-34547cd4-9aa7-4eac-b261-8216a8cdf477" released by "_delete_snapshot" :: held 2.077s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" released by "delete_snapshot" :: held 2.116s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Volume volume-92263388-89c5-4410-a536-90ba3001ffa3 (92263388-89c5-4410-a536-90ba3001ffa3): created successfully Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6a0cea-4874-459a-a5c3-95336f42cda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (06212e70-c559-4c4d-9376-83aaf6087ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e70e6e6b-89e0-4365-94b4-5a767b253cc5 tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Flow 'volume_create_manager' (c5840de4-6686-4bc3-a899-83f5862d2413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d650895f-4dee-4d7c-abe9-8f35e83f55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d650895f-4dee-4d7c-abe9-8f35e83f55e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-671705895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebaf9f-4afe-4c93-8351-18e8f53ff108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a96c9965f79432889f8914556822f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:29Z,use_quota=True,user_id='48a796c8ad744518bad747227dafbb4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3daef60-05fc-4560-bf14-a8c0a938422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3daef60-05fc-4560-bf14-a8c0a938422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fdfc4e-d4b5-4169-a0a7-6bd26140cfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fdfc4e-d4b5-4169-a0a7-6bd26140cfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beebaf9f-4afe-4c93-8351-18e8f53ff108', 'volume_name': 'volume-beebaf9f-4afe-4c93-8351-18e8f53ff108', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d5cce4-5342-4b44-91dc-9d8b86a9e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68d5cce4-5342-4b44-91dc-9d8b86a9e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d701ffdb-62bc-40bf-9e85-2fca131c7fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Volume beebaf9f-4afe-4c93-8351-18e8f53ff108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beebaf9f-4afe-4c93-8351-18e8f53ff108', 'volume_size': 1} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-671705895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beebaf9f-4afe-4c93-8351-18e8f53ff108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a96c9965f79432889f8914556822f8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:29Z,use_quota=True,user_id='48a796c8ad744518bad747227dafbb4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Creating volume beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:29 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:29 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 1073741824 Sep 17 15:04:29 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Created reservations ['2d2771d3-36e3-42c1-85df-f4077ec6e2ef', '815da4ad-92c2-423f-934c-2339861573ae', 'f6bfbad9-0de9-49ca-8c0b-7635cd62fb90', 'f8a5d2bc-26ff-434a-899a-4cc0951bcf3e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Delete snapshot completed successfully. Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-34547cd4-9aa7-4eac-b261-8216a8cdf477-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-900828c6-cd76-4495-b7a5-e3d5d0de37ed-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-900828c6-cd76-4495-b7a5-e3d5d0de37ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-900828c6-cd76-4495-b7a5-e3d5d0de37ed" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-900828c6-cd76-4495-b7a5-e3d5d0de37ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Deleting offline snapshot 900828c6-cd76-4495-b7a5-e3d5d0de37ed of volume bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] snapshot_file for this snap is: volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f34715d-991e-40b0-9199-3a44cadbf825]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:30 devstack sudo[93988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:30 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:30 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 1073741824" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:30 devstack sudo[93991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 Sep 17 15:04:30 devstack sudo[93991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:30 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf33703b-a8b5-4baa-ba88-11f3a0423582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ea7943-7165-431c-9126-8a5c10b892e3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:30 devstack sudo[93991]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d701ffdb-62bc-40bf-9e85-2fca131c7fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beebaf9f-4afe-4c93-8351-18e8f53ff108', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec969ba7-c6da-47cf-a736-e9d8626fe4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=207,cinder:UPDATE=204,cinder:INSERT=61,cinder:DELETE=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:04:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Volume volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 (beebaf9f-4afe-4c93-8351-18e8f53ff108): created successfully Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec969ba7-c6da-47cf-a736-e9d8626fe4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Flow 'volume_create_manager' (c5840de4-6686-4bc3-a899-83f5862d2413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:30 devstack sudo[93996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 Sep 17 15:04:30 devstack sudo[93996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-67e6a855-7e50-4750-b98d-99281aace706 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Created volume successfully. Sep 17 15:04:30 devstack sudo[93996]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582" returned: 0 in 0.522s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:30 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:30 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a48cca74-7374-440d-8a87-5721c3512242 tempest-GroupsV314Test-1916872682 None] Group tempest-GroupsV314Test-Group-1201753706: creating Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=179,cinder:INSERT=43,cinder:UPDATE=203,cinder:DELETE=12 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a48cca74-7374-440d-8a87-5721c3512242 tempest-GroupsV314Test-1916872682 None] Group tempest-GroupsV314Test-Group-1201753706: created successfully Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a48cca74-7374-440d-8a87-5721c3512242 tempest-GroupsV314Test-1916872682 None] Create group completed successfully. Sep 17 15:04:31 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:31 devstack sudo[94008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed Sep 17 15:04:31 devstack sudo[94008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (4af685bb-2232-4c59-8ebd-f377485dcbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787ab22-ed7b-4cf6-b21f-249df1519cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:31 devstack sudo[94008]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0787ab22-ed7b-4cf6-b21f-249df1519cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1313356450',display_name='tempest-VolumesGetTest-Volume-918244732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59484642-2a7c-4a05-ae3a-d0cb54e561ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:32Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1140267-7ecb-4af5-84d5-9ff7c3b34ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1140267-7ecb-4af5-84d5-9ff7c3b34ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863b89c6-33fa-4b09-8c31-43594bbf750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (863b89c6-33fa-4b09-8c31-43594bbf750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59484642-2a7c-4a05-ae3a-d0cb54e561ad', 'volume_name': 'volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2b76d-86f3-479d-b065-b5c179403c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21d2b76d-86f3-479d-b065-b5c179403c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8628af8c-9158-4fce-b3bc-51de95d4f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Volume 59484642-2a7c-4a05-ae3a-d0cb54e561ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad', 'volume_size': 1} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1313356450',display_name='tempest-VolumesGetTest-Volume-918244732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59484642-2a7c-4a05-ae3a-d0cb54e561ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:32Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Creating volume 59484642-2a7c-4a05-ae3a-d0cb54e561ad {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582.900828c6-cd76-4495-b7a5-e3d5d0de37ed" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:31 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad 1073741824 Sep 17 15:04:31 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-900828c6-cd76-4495-b7a5-e3d5d0de37ed" released by "_delete_snapshot" :: held 1.888s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" released by "delete_snapshot" :: held 1.913s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Created reservations ['9f472b82-4231-4d85-9cf9-4e0e0154113e', '639a99d3-e359-4ab3-a519-aba437354f12', 'f7f86ef8-d84e-4e72-82be-c639480e7e80', '9dbed23b-26ef-42be-baf5-b23f99a9b311'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Delete snapshot completed successfully. Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-900828c6-cd76-4495-b7a5-e3d5d0de37ed-delete_snapshot" released by "delete_snapshot" :: held 2.085s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Snapshots deleted, issuing volume delete {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d480cb3-c726-49a3-ac55-0fe6138a8251]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:32 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 Sep 17 15:04:32 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:32 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad 1073741824" returned: 0 in 0.468s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:32 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad Sep 17 15:04:32 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:32 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:32 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582 Sep 17 15:04:32 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:32 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Creating offline snapshot 7f150dfa-e57e-43c3-92b5-c39e4f2445c0 of volume beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8628af8c-9158-4fce-b3bc-51de95d4f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6409713a-4aba-4a07-9369-c2fbbf8a8ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ecb1c5-fc75-4216-b69f-b45fd138180a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Volume volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad (59484642-2a7c-4a05-ae3a-d0cb54e561ad): created successfully Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6409713a-4aba-4a07-9369-c2fbbf8a8ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (4af685bb-2232-4c59-8ebd-f377485dcbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7ba5c0f1-2069-4bcd-9c5d-e51e49a3d133 tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:04:32 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 Sep 17 15:04:32 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:32 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf33703b-a8b5-4baa-ba88-11f3a0423582" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-bf33703b-a8b5-4baa-ba88-11f3a0423582" released by "delete_volume" :: held 0.766s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Created reservations ['48cba817-6106-4cf8-a01d-7c1ae662e7e8', '09966c02-3b45-47d7-935a-7f642759e607', 'eacb7e4c-381f-4594-92f0-8a587fad5833', '687b9f48-5003-401c-a873-4940a7e19b92'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:32 devstack sudo[94029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:32 devstack sudo[94029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:33 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:33 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 1G Sep 17 15:04:33 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Flow 'volume_create_manager' (ee4d2ee9-41d0-46d8-b220-a56be0340afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13151cf3-99b5-428d-814b-e2a402ddf46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13151cf3-99b5-428d-814b-e2a402ddf46e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884832423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56eeb444-5f37-47fa-bb3a-7d6b24a31fb9,host='devstack@QuobyteHD#QuobyteHD',id=a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a492c9390c4ad2983696ac73b330fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:33Z,use_quota=True,user_id='54706bfc32994a5382f828fd0fd6de87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b2abf0-8bd4-47b3-b6de-685bebd9a888),volume_type_id=11b2abf0-8bd4-47b3-b6de-685bebd9a888)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:33 devstack sudo[94029]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676e9ba0-5214-4ada-905f-3021487dbdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676e9ba0-5214-4ada-905f-3021487dbdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6115721d-f882-4c03-a6f9-6fa0fdc793ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6115721d-f882-4c03-a6f9-6fa0fdc793ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3', 'volume_name': 'volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b9e73c-c715-4415-8569-fd8f3ef9b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b9e73c-c715-4415-8569-fd8f3ef9b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c520c5-8fee-4456-8f69-1c4f3eb380f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Volume a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3', 'volume_size': 1} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Deleted volume successfully. Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8f9d6152-21ec-42c7-a60a-d6a9c8609275 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-bf33703b-a8b5-4baa-ba88-11f3a0423582-delete_volume" released by "delete_volume" :: held 5.935s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:33 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 1G" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:33 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 Sep 17 15:04:33 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:33 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:33 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 is being set with open permissions: ugo+rw Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-59484642-2a7c-4a05-ae3a-d0cb54e561ad-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:33 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 Sep 17 15:04:33 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "cinder-59484642-2a7c-4a05-ae3a-d0cb54e561ad-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-59484642-2a7c-4a05-ae3a-d0cb54e561ad" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-59484642-2a7c-4a05-ae3a-d0cb54e561ad" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d72292-9007-47a7-8592-20aa9a40954d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad Sep 17 15:04:34 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:34 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info Sep 17 15:04:34 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:34 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad Sep 17 15:04:34 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:34 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info is being set with open permissions: ugo+rw Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info Sep 17 15:04:34 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:34 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59484642-2a7c-4a05-ae3a-d0cb54e561ad" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-59484642-2a7c-4a05-ae3a-d0cb54e561ad" released by "delete_volume" :: held 0.760s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Created reservations ['f017d123-1275-4bc9-b780-1e1eda116551', '87f63b3a-b7ef-46c4-a09d-d5e3a4eb6352', '369a31ab-5e82-475c-98bc-9299904e599d', '9d526652-a196-4811-835a-61927f010ca6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:34 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.info" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56eeb444-5f37-47fa-bb3a-7d6b24a31fb9,created_at=2026-09-17T13:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1884832423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56eeb444-5f37-47fa-bb3a-7d6b24a31fb9,host='devstack@QuobyteHD#QuobyteHD',id=a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a492c9390c4ad2983696ac73b330fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:33Z,use_quota=True,user_id='54706bfc32994a5382f828fd0fd6de87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11b2abf0-8bd4-47b3-b6de-685bebd9a888),volume_type_id=11b2abf0-8bd4-47b3-b6de-685bebd9a888)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Creating volume a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 1073741824 Sep 17 15:04:34 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (1e5f9bf4-216a-4c35-9f7e-247e064e3303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1ff660-62ae-4329-b157-1e9b7d983ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1ff660-62ae-4329-b157-1e9b7d983ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-8924886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e840e393-d28e-4f4f-a39f-effc6d292df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94bdf4e614d9d882756cbb9d689e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:35Z,use_quota=True,user_id='4dcf57d6d84a4fc8b3426589d85af5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564cba7b-fee3-4451-93bb-0216e9941da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564cba7b-fee3-4451-93bb-0216e9941da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0ee0e8-89b6-454a-8d3f-4f1cd1b77007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0ee0e8-89b6-454a-8d3f-4f1cd1b77007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e840e393-d28e-4f4f-a39f-effc6d292df2', 'volume_name': 'volume-e840e393-d28e-4f4f-a39f-effc6d292df2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3f0634-735e-4202-8609-b81dd6399ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3f0634-735e-4202-8609-b81dd6399ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0fcadc-e0db-40d8-b76a-34269e7b0b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Volume e840e393-d28e-4f4f-a39f-effc6d292df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e840e393-d28e-4f4f-a39f-effc6d292df2', 'volume_size': 1} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-598febb3-9a3b-44fa-aaf2-ddf85c1672a8 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Create snapshot completed successfully Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:34 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:34 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-92263388-89c5-4410-a536-90ba3001ffa3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "cinder-92263388-89c5-4410-a536-90ba3001ffa3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-92263388-89c5-4410-a536-90ba3001ffa3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-92263388-89c5-4410-a536-90ba3001ffa3" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2776353-fc1f-4ccf-a799-2cfaf671336d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:35 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5cc090ad-fea7-4e80-bf3a-b26b76820197 tempest-VolumesGetTest-996746258 None] Lock "cinder-59484642-2a7c-4a05-ae3a-d0cb54e561ad-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:35 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 Sep 17 15:04:35 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 1073741824" returned: 0 in 0.617s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:35 devstack sudo[94073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:35 devstack sudo[94073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "cinder-7f150dfa-e57e-43c3-92b5-c39e4f2445c0-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-7f150dfa-e57e-43c3-92b5-c39e4f2445c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" acquired by "delete_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "cinder-quobyte-7f150dfa-e57e-43c3-92b5-c39e4f2445c0" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-7f150dfa-e57e-43c3-92b5-c39e4f2445c0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Deleting offline snapshot 7f150dfa-e57e-43c3-92b5-c39e4f2445c0 of volume beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:35 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] snapshot_file for this snap is: volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:35 devstack sudo[94073]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0766e128-363a-4033-9e37-e110654ab526]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-8924886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e840e393-d28e-4f4f-a39f-effc6d292df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94bdf4e614d9d882756cbb9d689e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:35Z,use_quota=True,user_id='4dcf57d6d84a4fc8b3426589d85af5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Creating volume e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:35 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3 Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:35 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:35 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 1073741824 Sep 17 15:04:35 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4c520c5-8fee-4456-8f69-1c4f3eb380f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6705133d-094a-483c-b30c-13512c23db73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Volume volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 (a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3): created successfully Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6705133d-094a-483c-b30c-13512c23db73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Flow 'volume_create_manager' (ee4d2ee9-41d0-46d8-b220-a56be0340afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-617106eb-acd4-450f-baaa-3a07442a6e7a tempest-GroupsV314Test-1916872682 None] Created volume successfully. Sep 17 15:04:35 devstack sudo[94082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 Sep 17 15:04:35 devstack sudo[94082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:35 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-92263388-89c5-4410-a536-90ba3001ffa3" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-92263388-89c5-4410-a536-90ba3001ffa3" released by "delete_volume" :: held 0.846s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Created reservations ['15f2b56f-cce0-471b-8a14-67aa8816b1ac', 'ad31bf01-4ae8-4dc3-aab5-55ebad91b915', '4ffb6474-7074-464d-b60b-6c3bdede6a8c', '2dbb2f9e-3689-41b3-b1f2-30f70a8a8436'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:36 devstack sudo[94092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:36 devstack sudo[94092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:36 devstack sudo[94082]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beebaf9f-4afe-4c93-8351-18e8f53ff108(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb3047b-47c6-4ff4-ba5e-b58cdc753d9d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:36 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 1073741824" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:36 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 Sep 17 15:04:36 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:36 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:04:36 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:36 devstack sudo[94092]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7b9dafdc-7b61-43eb-aadf-04bbe12f04c0 tempest-VolumesGetTest-996746258 None] Lock "cinder-92263388-89c5-4410-a536-90ba3001ffa3-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:36 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af0fcadc-e0db-40d8-b76a-34269e7b0b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e840e393-d28e-4f4f-a39f-effc6d292df2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e99a130-4987-474d-8bf1-225f811ff1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Volume volume-e840e393-d28e-4f4f-a39f-effc6d292df2 (e840e393-d28e-4f4f-a39f-effc6d292df2): created successfully Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e99a130-4987-474d-8bf1-225f811ff1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (1e5f9bf4-216a-4c35-9f7e-247e064e3303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108" returned: 0 in 0.550s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2f76e1fb-ba27-44ad-a507-3162d69d024e tempest-VolumesDeleteCascade-274568745 None] Created volume successfully. Sep 17 15:04:36 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 Sep 17 15:04:36 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (aa19bb27-e46f-488d-99a6-755be9ccab93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ceb24-e14e-4bc5-85e1-e5b552d9ff1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f25ceb24-e14e-4bc5-85e1-e5b552d9ff1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1402895794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:37Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a225df-74cb-409e-bcc4-a4b749bf47bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a225df-74cb-409e-bcc4-a4b749bf47bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d606de-5cce-4b9b-ac40-90a4568b227c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d606de-5cce-4b9b-ac40-90a4568b227c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'volume_name': 'volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff4790d-4c79-481a-a0d0-5cd33e0be6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff4790d-4c79-481a-a0d0-5cd33e0be6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e78906-d637-4109-b935-237a5c986227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Volume f370a0e2-a906-4dad-ba3e-a3b538a9c4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'volume_size': 1} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1402895794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:37Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Creating volume f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:04:36 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:04:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:37 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 1073741824 Sep 17 15:04:37 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:37 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0" returned: 0 in 0.394s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:37 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0 Sep 17 15:04:37 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:37 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 1073741824" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:37 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108.7f150dfa-e57e-43c3-92b5-c39e4f2445c0" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:37 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:04:37 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-7f150dfa-e57e-43c3-92b5-c39e4f2445c0" released by "_delete_snapshot" :: held 1.903s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" released by "delete_snapshot" :: held 1.932s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Created reservations ['7b66f5d8-cbaf-41c3-bd75-f0452aa4f766', '523b644e-063a-48a0-a782-00ef0eaaf6a7', 'b8c8ea64-d337-43de-867f-e0ada07a38e9', 'bdcee5f4-0882-44d1-8583-7663a31a6df0'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Delete snapshot completed successfully. Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-690c2a59-f6ee-49e0-81d9-9ce8349bcd40 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-7f150dfa-e57e-43c3-92b5-c39e4f2445c0-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:37 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.473s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Cloning volume a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 to volume 5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0e78906-d637-4109-b935-237a5c986227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d31832e-4ceb-4414-92a8-140751981bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Creating offline snapshot 9c9d937f-87e1-458d-b6e6-4a5e9288cf38 of volume a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Volume volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 (f370a0e2-a906-4dad-ba3e-a3b538a9c4f3): created successfully Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d31832e-4ceb-4414-92a8-140751981bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (aa19bb27-e46f-488d-99a6-755be9ccab93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "cinder-beebaf9f-4afe-4c93-8351-18e8f53ff108-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a563f2-2a4e-4fa6-b071-ee887d56aa43]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-425c84ac-75f1-484a-9da4-400f7c3f2c7c tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:04:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-beebaf9f-4afe-4c93-8351-18e8f53ff108-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:38 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:38 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[461310a0-1aed-472e-8cc3-d8425214e505]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:38 devstack sudo[94156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 Sep 17 15:04:38 devstack sudo[94156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:38 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.561s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:38 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 1G Sep 17 15:04:38 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:38 devstack sudo[94156]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:38 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108 Sep 17 15:04:38 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:38 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-beebaf9f-4afe-4c93-8351-18e8f53ff108" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-quobyte-beebaf9f-4afe-4c93-8351-18e8f53ff108" released by "delete_volume" :: held 0.836s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:38 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 1G" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:38 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:38 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Created reservations ['9aabca7c-8a2c-4f52-bb3b-8c6155b58805', 'b235b4ca-4737-4a2f-b6d9-90ae69b53852', 'faa4f4bb-7c6e-4058-bd6e-6477797075d0', '52087b07-f3cc-4478-8006-6cff27945cbe'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:39 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:39 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:39 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:39 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:39 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:39 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Deleted volume successfully. Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72e0c1eb-ad8b-43fc-9863-b2ae6d309395 tempest-VolumeSnapshotQuotasNegativeTestJSON-2099867420 None] Lock "cinder-beebaf9f-4afe-4c93-8351-18e8f53ff108-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:39 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (6ee00f49-acba-4ac6-8fdf-75e2bb14ef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89004930-95bf-44a9-8445-187973c05330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89004930-95bf-44a9-8445-187973c05330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1436663296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb847372-bbfa-4a0b-85d5-f9282df64110,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:40Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace94a33-063a-428c-945b-17f23c6131b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace94a33-063a-428c-945b-17f23c6131b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7882baf6-4e5a-4335-896e-141f02b012d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7882baf6-4e5a-4335-896e-141f02b012d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cb847372-bbfa-4a0b-85d5-f9282df64110', 'volume_name': 'volume-cb847372-bbfa-4a0b-85d5-f9282df64110', 'volume_size': 1, 'source_volid': 'f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb437a4-6557-47c2-bc40-979f415b508b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb437a4-6557-47c2-bc40-979f415b508b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f41618-9933-4fc9-a570-96a09aca2765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Volume cb847372-bbfa-4a0b-85d5-f9282df64110: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cb847372-bbfa-4a0b-85d5-f9282df64110', 'volume_size': 1, 'source_volid': 'f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'source_volstatus': 'available'} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:39 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info Sep 17 15:04:39 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:40 devstack sudo[94189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info Sep 17 15:04:40 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.info" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Acquiring lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] snapshot: 9c9d937f-87e1-458d-b6e6-4a5e9288cf38, volume: 5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[512149a2-fbff-4cd1-acf1-e0077eed73ca]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:40 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:40 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:40 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b5ce9-ff72-4ccd-908b-5a766022cc30]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:40 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:40 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:41 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:04:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:04:41 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:04:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:41 devstack sudo[94203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 Sep 17 15:04:41 devstack sudo[94203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Flow 'volume_create_manager' (c11f9278-fd5f-451f-bbd6-05f33a8bdfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c904051f-f1ee-4c16-825e-cf6ecfa1b318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c904051f-f1ee-4c16-825e-cf6ecfa1b318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-943760591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d927d711-6fa9-40ff-bdc6-7b0423ec2180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27362ae441e64165be3de8ceb0ebb829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:48Z,use_quota=True,user_id='155db0bdc7134ad89ff860328d4a7389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(284b224e-332e-4063-aaf7-ad3ad00dfe04),volume_type_id=284b224e-332e-4063-aaf7-ad3ad00dfe04)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8901e178-18a1-420a-8910-ef12def36c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8901e178-18a1-420a-8910-ef12def36c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea7ca66-13d2-4feb-9753-1c5c75f9c60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea7ca66-13d2-4feb-9753-1c5c75f9c60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd927d711-6fa9-40ff-bdc6-7b0423ec2180', 'volume_name': 'volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48aa43ea-29ec-4f6c-a5bf-0dd1fadc63cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48aa43ea-29ec-4f6c-a5bf-0dd1fadc63cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b96969-0e3e-45f5-819b-09a914320500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Volume d927d711-6fa9-40ff-bdc6-7b0423ec2180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180', 'volume_size': 1} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:48 devstack sudo[94203]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" returned: 0 in 7.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:04:48 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Converted 1024.00 MB image at 139.94 MB/s Sep 17 15:04:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 is being set with open permissions: ugo+rw: NotImplementedError Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 Sep 17 15:04:48 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:48 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" released by "_copy_volume_from_snapshot" :: held 8.449s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Acquiring lock "cinder-quobyte-9c9d937f-87e1-458d-b6e6-4a5e9288cf38" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-9c9d937f-87e1-458d-b6e6-4a5e9288cf38" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Deleting offline snapshot 9c9d937f-87e1-458d-b6e6-4a5e9288cf38 of volume a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] snapshot_file for this snap is: volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c7d6e2-3bf0-4b89-b66f-a41dc41ab681]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:48 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:48 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:49 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b674ad31-860e-4e0c-a2ba-9a5b54004df5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:49 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:49 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:49 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:49 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:49 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:50 devstack sudo[94241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38 Sep 17 15:04:50 devstack sudo[94241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[94241]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3.9c9d937f-87e1-458d-b6e6-4a5e9288cf38" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-9c9d937f-87e1-458d-b6e6-4a5e9288cf38" released by "_delete_snapshot" :: held 1.540s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.583s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.190s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Creating offline snapshot 04469111-e06d-449e-a9fb-7c32f9695599 of volume e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9510a6e6-08e7-411f-a879-b6f89573f029]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-257eff43-2744-4868-9ef5-8763fa0ca9b0 tempest-GroupsV314Test-1916872682 None] Create group from source-group-56eeb444-5f37-47fa-bb3a-7d6b24a31fb9 completed successfully. Sep 17 15:04:50 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:04:50 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:50 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:50 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 1G Sep 17 15:04:50 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 1G" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e840e393-d28e-4f4f-a39f-effc6d292df2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[94257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e840e393-d28e-4f4f-a39f-effc6d292df2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:04:51 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Acquiring lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf655b1-6de1-44ff-9d83-4e03771f54ae]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e840e393-d28e-4f4f-a39f-effc6d292df2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 is being set with open permissions: ugo+rw Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 Sep 17 15:04:51 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:04:51 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" returned: 0 in 0.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8 Sep 17 15:04:51 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:51 devstack sudo[94273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info Sep 17 15:04:51 devstack sudo[94273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:52 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" returned: 0 in 0.247s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-5ca53c9a-28d9-4bde-9260-d3c0b00cb8a8" released by "delete_volume" :: held 0.673s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:52 devstack sudo[94273]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:52 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info is being set with open permissions: ugo+rw Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:52 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info Sep 17 15:04:52 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Created reservations ['86a7441b-6ae3-4739-ae46-9b89515473c6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:52 devstack cinder-volume[85963]: WARNING cinder.quota [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-755007180 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-755007180, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:52 devstack cinder-volume[85963]: WARNING cinder.quota [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-755007180 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-755007180, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Created reservations ['2fc2fa37-d77b-403b-a25e-76aa1816a73b', '703151b8-cf4b-4972-bd6c-8cd3d4aab7d3', 'bced8306-e7ef-42bb-bec1-7f0f6c2858f8', '0b623405-9db6-4aff-8d31-a40cca5ea3cf'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:52 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:52 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:52 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.info" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 12.622s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:52 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Cloning volume f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 to volume cb847372-bbfa-4a0b-85d5-f9282df64110 Sep 17 15:04:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1c75865-d030-452c-bbcc-24f83015f7ef tempest-VolumesDeleteCascade-274568745 None] Create snapshot completed successfully Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Creating offline snapshot e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 of volume f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[af594f05-4697-4546-9817-07e3f334aefa]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:52 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b1a9dadd-238a-4443-8ca2-c58fa9d24921 tempest-GroupsV314Test-1916872682 None] Delete group completed successfully. Sep 17 15:04:52 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:04:52 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Acquiring lock "cinder-quobyte-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:52 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d043ebc5-95e2-4103-98cd-be34453214e7]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:52 devstack sudo[94288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 1G Sep 17 15:04:52 devstack sudo[94288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:52 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:52 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:53 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:53 devstack sudo[94299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3 Sep 17 15:04:53 devstack sudo[94299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:53 devstack sudo[94288]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 1G" returned: 0 in 0.478s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:53 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:04:53 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:53 devstack sudo[94299]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Lock "cinder-quobyte-a69356ee-7eb6-4ec1-9d5d-e8459f8fe2e3" released by "delete_volume" :: held 0.811s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:04:53 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (8915981f-e70e-4356-823c-43f287eedc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158183cd-d8fc-4639-841d-c55b967ed06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:53 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 is being set with open permissions: ugo+rw Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:53 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:04:53 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158183cd-d8fc-4639-841d-c55b967ed06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-130922407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a489f08b-caf6-416d-8db2-b3ea920302be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fa94bdf4e614d9d882756cbb9d689e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04469111-e06d-449e-a9fb-7c32f9695599,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:54Z,use_quota=True,user_id='4dcf57d6d84a4fc8b3426589d85af5b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2fa75d-e47c-46c1-aab7-64243792a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2fa75d-e47c-46c1-aab7-64243792a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f134eb7-f475-44e1-b56a-17b490abc02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f134eb7-f475-44e1-b56a-17b490abc02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a489f08b-caf6-416d-8db2-b3ea920302be', 'volume_name': 'volume-a489f08b-caf6-416d-8db2-b3ea920302be', 'volume_size': 1, 'snapshot_id': '04469111-e06d-449e-a9fb-7c32f9695599'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ead550-4767-4db2-b3be-fb9ac311744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ead550-4767-4db2-b3be-fb9ac311744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087656ba-e981-4553-8541-8223ca80d5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:04:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Volume a489f08b-caf6-416d-8db2-b3ea920302be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a489f08b-caf6-416d-8db2-b3ea920302be', 'volume_size': 1, 'snapshot_id': '04469111-e06d-449e-a9fb-7c32f9695599'} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Created reservations ['bc55870d-2359-4222-bedf-c79c372284d7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Created reservations ['272af066-c736-4fe3-a0d7-4791f2a6e2bb', '9917cc4a-b16f-4dd0-8ef2-e096c6fca619', 'abf5be27-7163-4754-81a9-edc1c10c85a5', 'a4fd4971-898c-40fc-814a-3a73b1670c2b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:53 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:53 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:53 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:54 devstack sudo[94312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info Sep 17 15:04:54 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:54 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fa7839aa-7fdd-4e82-b8d6-b54194cfbed8 tempest-GroupsV314Test-1916872682 None] Delete group completed successfully. Sep 17 15:04:54 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:54 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info is being set with open permissions: ugo+rw Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:54 devstack sudo[94316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info Sep 17 15:04:54 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:54 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.info" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] snapshot: e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4, volume: cb847372-bbfa-4a0b-85d5-f9282df64110, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d09834-7d46-4d75-bd3b-e24d88cc7f5f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:54 devstack sudo[94319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:04:54 devstack sudo[94319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:54 devstack sudo[94319]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[346f8d4b-a69e-4cd1-bf20-27cf5842cdbd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:55 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:04:55 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:55 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:04:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:55 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 Sep 17 15:04:55 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:04:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:04:57 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:04:57 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:04:57 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Sep 17 15:04:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:04:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:04:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:04:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:04:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Flow 'volume_create_manager' (e75cf1cc-1d53-4815-92e1-7f3a1434edbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254152ee-75c0-4668-a8de-8c3fbe3614d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (254152ee-75c0-4668-a8de-8c3fbe3614d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-167890220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e8b17d-8625-4a46-a432-47d74fb3918a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfb466ca9a74d6697557d1e9b06d380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:02Z,use_quota=True,user_id='36b4f27299de42328a4ba9c378a1f402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b4aed7-16c4-475f-bd3d-31e39f67f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b4aed7-16c4-475f-bd3d-31e39f67f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3bf864-7c31-4e6e-bbae-55adc28216c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3bf864-7c31-4e6e-bbae-55adc28216c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e8b17d-8625-4a46-a432-47d74fb3918a', 'volume_name': 'volume-01e8b17d-8625-4a46-a432-47d74fb3918a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64ffe2c-a7e5-485f-a80e-c763c178a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e64ffe2c-a7e5-485f-a80e-c763c178a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc49e143-4319-4408-9f78-a3f97b28231a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Volume 01e8b17d-8625-4a46-a432-47d74fb3918a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e8b17d-8625-4a46-a432-47d74fb3918a', 'volume_size': 1} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:02 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110" returned: 0 in 7.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:05:02 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Converted 1024.00 MB image at 138.95 MB/s Sep 17 15:05:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 is being set with open permissions: ugo+rw Sep 17 15:05:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:02 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 Sep 17 15:05:02 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110" returned: 0 in 0.238s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" released by "_copy_volume_from_snapshot" :: held 8.433s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Deleting offline snapshot e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 of volume f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] snapshot_file for this snap is: volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa41065-8b76-487b-baae-24759b525d0b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:05:03 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dec268-e549-4b7b-a406-32d993ab2b81]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:05:03 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:03 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.497s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:03 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:05:03 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4 Sep 17 15:05:04 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3.e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-e0c81b3d-6043-4f9a-b1e9-1c1cf80c97d4" released by "_delete_snapshot" :: held 1.516s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.209s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.160s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-943760591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d927d711-6fa9-40ff-bdc6-7b0423ec2180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27362ae441e64165be3de8ceb0ebb829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:04:48Z,use_quota=True,user_id='155db0bdc7134ad89ff860328d4a7389',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(284b224e-332e-4063-aaf7-ad3ad00dfe04),volume_type_id=284b224e-332e-4063-aaf7-ad3ad00dfe04)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Creating volume d927d711-6fa9-40ff-bdc6-7b0423ec2180 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:04 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:04 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 1073741824 Sep 17 15:05:04 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f41618-9933-4fc9-a570-96a09aca2765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb847372-bbfa-4a0b-85d5-f9282df64110', 'volume_size': 1, 'source_volid': 'f370a0e2-a906-4dad-ba3e-a3b538a9c4f3', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2782a2e7-11cb-42b0-b0dc-9b754730f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Volume volume-cb847372-bbfa-4a0b-85d5-f9282df64110 (cb847372-bbfa-4a0b-85d5-f9282df64110): created successfully Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2782a2e7-11cb-42b0-b0dc-9b754730f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (6ee00f49-acba-4ac6-8fdf-75e2bb14ef1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9d56a7d7-7b3f-44f6-a53b-9832800e3c06 tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:05:05 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 1073741824" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 Sep 17 15:05:05 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 11.549s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599-a489f08b-caf6-416d-8db2-b3ea920302be" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2b96969-0e3e-45f5-819b-09a914320500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3699fba-e811-4e36-a890-5b2937603e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599-a489f08b-caf6-416d-8db2-b3ea920302be" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Creating volume a489f08b-caf6-416d-8db2-b3ea920302be from snapshot 04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Volume volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 (d927d711-6fa9-40ff-bdc6-7b0423ec2180): created successfully Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3699fba-e811-4e36-a890-5b2937603e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Flow 'volume_create_manager' (c11f9278-fd5f-451f-bbd6-05f33a8bdfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] snapshot: 04469111-e06d-449e-a9fb-7c32f9695599, volume: a489f08b-caf6-416d-8db2-b3ea920302be, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:05:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e0aaba7e-05b3-469d-90ed-dbf67441cee4 tempest-VolumeTypesAccessTest-1581139109 None] Created volume successfully. Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c77d16f-7b0b-4f5e-a335-087ad53f5e7d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:05:05 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:05 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e840e393-d28e-4f4f-a39f-effc6d292df2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef83354c-eb0b-4069-86d8-044d4c980f54]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:05 devstack sudo[94387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:05:05 devstack sudo[94387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:06 devstack sudo[94387]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:06 devstack sudo[94392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be Sep 17 15:05:06 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (38a42f15-7e02-48c7-b9bb-4f58a15ee80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366d80c-2e07-4b18-b472-1870d65c5564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0366d80c-2e07-4b18-b472-1870d65c5564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-252380167',display_name='tempest-VolumesGetTest-Volume-5264276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9793a875-6936-447b-b091-8dfa14e150d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:06Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9401a985-876c-4cb5-9f42-9e40c6766442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9401a985-876c-4cb5-9f42-9e40c6766442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa433091-8180-4729-910a-8ce4f1de4c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa433091-8180-4729-910a-8ce4f1de4c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9793a875-6936-447b-b091-8dfa14e150d7', 'volume_name': 'volume-9793a875-6936-447b-b091-8dfa14e150d7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc4ca16-bed3-4f3f-aa09-c3b4d81868b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abc4ca16-bed3-4f3f-aa09-c3b4d81868b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427231ec-e5b1-418b-a307-ae1772c28a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Volume 9793a875-6936-447b-b091-8dfa14e150d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9793a875-6936-447b-b091-8dfa14e150d7', 'volume_size': 1} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Acquiring lock "cinder-d927d711-6fa9-40ff-bdc6-7b0423ec2180-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "cinder-d927d711-6fa9-40ff-bdc6-7b0423ec2180-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Acquiring lock "cinder-quobyte-d927d711-6fa9-40ff-bdc6-7b0423ec2180" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "cinder-quobyte-d927d711-6fa9-40ff-bdc6-7b0423ec2180" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea6503-9bd6-41eb-8230-1f60f4720043]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:06 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 Sep 17 15:05:06 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:07 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180" returned: 0 in 0.560s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:07 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180 Sep 17 15:05:07 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:07 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d927d711-6fa9-40ff-bdc6-7b0423ec2180" returned: 0 in 0.450s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "cinder-quobyte-d927d711-6fa9-40ff-bdc6-7b0423ec2180" released by "delete_volume" :: held 1.070s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:07 devstack cinder-volume[85963]: WARNING cinder.quota [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-121933300 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-121933300, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:05:07 devstack cinder-volume[85963]: WARNING cinder.quota [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-121933300 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-121933300, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:05:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Created reservations ['6d511330-0d17-407c-8423-eb5c41a64d98', '60844674-e4bd-4d35-b68c-61adc72d0d41', '8841d480-980e-4604-a3af-a9e5b648f0a8', '4d40c3fd-c8d7-4219-8cc5-601a7ae2d027'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:08 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:08 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:08 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Deleted volume successfully. Sep 17 15:05:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89db027a-fb68-4ed6-b0a7-0273acb77840 tempest-VolumeTypesAccessTest-1581139109 None] Lock "cinder-d927d711-6fa9-40ff-bdc6-7b0423ec2180-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:13 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be" returned: 0 in 7.484s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:05:13 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Converted 1024.00 MB image at 136.80 MB/s Sep 17 15:05:13 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be is being set with open permissions: ugo+rw Sep 17 15:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:13 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be Sep 17 15:05:13 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:13 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" released by "_copy_volume_from_snapshot" :: held 8.583s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599-a489f08b-caf6-416d-8db2-b3ea920302be" released by "_create_volume_from_snapshot" :: held 8.666s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.699s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.339s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-167890220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e8b17d-8625-4a46-a432-47d74fb3918a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cfb466ca9a74d6697557d1e9b06d380',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:02Z,use_quota=True,user_id='36b4f27299de42328a4ba9c378a1f402',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Creating volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:14 devstack sudo[94420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a 1073741824 Sep 17 15:05:14 devstack sudo[94420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087656ba-e981-4553-8541-8223ca80d5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a489f08b-caf6-416d-8db2-b3ea920302be', 'volume_size': 1, 'snapshot_id': '04469111-e06d-449e-a9fb-7c32f9695599'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137945fb-4e94-4a9a-9b24-63a5926f0eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Volume volume-a489f08b-caf6-416d-8db2-b3ea920302be (a489f08b-caf6-416d-8db2-b3ea920302be): created successfully Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137945fb-4e94-4a9a-9b24-63a5926f0eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Flow 'volume_create_manager' (8915981f-e70e-4356-823c-43f287eedc5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ca0ee8ed-8dac-4234-b540-48d2f3b08ae1 tempest-VolumesDeleteCascade-274568745 None] Created volume successfully. Sep 17 15:05:14 devstack sudo[94420]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a 1073741824" returned: 0 in 0.530s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-e840e393-d28e-4f4f-a39f-effc6d292df2-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-e840e393-d28e-4f4f-a39f-effc6d292df2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:14 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a Sep 17 15:05:14 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Performing cascade delete. {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-04469111-e06d-449e-a9fb-7c32f9695599-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-04469111-e06d-449e-a9fb-7c32f9695599-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Deleting offline snapshot 04469111-e06d-449e-a9fb-7c32f9695599 of volume e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] snapshot_file for this snap is: volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ca8155-82c7-4a51-8e14-c33e15d87b34]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:14 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a" returned: 0 in 0.267s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.305s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-252380167',display_name='tempest-VolumesGetTest-Volume-5264276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9793a875-6936-447b-b091-8dfa14e150d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:06Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Creating volume 9793a875-6936-447b-b091-8dfa14e150d7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:14 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:05:14 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc49e143-4319-4408-9f78-a3f97b28231a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e8b17d-8625-4a46-a432-47d74fb3918a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:14 devstack sudo[94430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 1073741824 Sep 17 15:05:14 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d27fbc1-db64-4c88-bd4a-d36e8dfe8a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Volume volume-01e8b17d-8625-4a46-a432-47d74fb3918a (01e8b17d-8625-4a46-a432-47d74fb3918a): created successfully Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d27fbc1-db64-4c88-bd4a-d36e8dfe8a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Flow 'volume_create_manager' (e75cf1cc-1d53-4815-92e1-7f3a1434edbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-89468cc3-815c-4881-815a-9a9cc2ac31f4 tempest-SnapshotsActionsTest-1909073258 None] Created volume successfully. Sep 17 15:05:15 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.446s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e840e393-d28e-4f4f-a39f-effc6d292df2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b4f2a0-2a42-48a4-a16b-dbe6c11ce4ec]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:15 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:05:15 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:15 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 1073741824" returned: 0 in 0.595s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:15 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 Sep 17 15:05:15 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:15 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.063s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:15 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (427231ec-e5b1-418b-a307-ae1772c28a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9793a875-6936-447b-b091-8dfa14e150d7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b47d5-20b7-47a3-87d5-4936df895042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Creating offline snapshot fdbcebb6-9844-4d04-b8d0-f80d09b927d6 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.711s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Volume volume-9793a875-6936-447b-b091-8dfa14e150d7 (9793a875-6936-447b-b091-8dfa14e150d7): created successfully Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c88b47d5-20b7-47a3-87d5-4936df895042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (38a42f15-7e02-48c7-b9bb-4f58a15ee80f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:16 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:05:16 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db87fc-cbc9-4510-89b6-774bc621d268]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-38bbaed4-b9b6-49dd-b794-2710cc5058dc tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:05:16 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a Sep 17 15:05:16 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:16 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:16 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:16 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599 Sep 17 15:05:16 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:16 devstack sudo[94460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 1G Sep 17 15:05:16 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-9793a875-6936-447b-b091-8dfa14e150d7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "cinder-9793a875-6936-447b-b091-8dfa14e150d7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-9793a875-6936-447b-b091-8dfa14e150d7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:16 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-9793a875-6936-447b-b091-8dfa14e150d7" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2.04469111-e06d-449e-a9fb-7c32f9695599" returned: 0 in 0.324s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64cb76-ccf8-498f-8e4d-c3ec152a2827]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-04469111-e06d-449e-a9fb-7c32f9695599" released by "_delete_snapshot" :: held 2.131s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" released by "delete_snapshot" :: held 2.160s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Created reservations ['6c064dd1-2b4c-48a1-a6ae-10ab4d685901', 'a74f012b-413f-497e-889f-bef8c82e3b5f', '3411f91c-eab1-41c5-9852-cd7834912066', '6e79177c-a36b-4e53-b05b-9dec3611ccad'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:17 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 Sep 17 15:05:17 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Delete snapshot completed successfully. Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-04469111-e06d-449e-a9fb-7c32f9695599-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Snapshots deleted, issuing volume delete {{(pid=85963) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:17 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 1G" returned: 0 in 0.588s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:17 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:17 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ca907c-b5a8-41ee-9ac9-524484be2929]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7" returned: 0 in 0.475s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:05:17 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7 Sep 17 15:05:17 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 is being set with open permissions: ugo+rw Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:17 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9793a875-6936-447b-b091-8dfa14e150d7" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-9793a875-6936-447b-b091-8dfa14e150d7" released by "delete_volume" :: held 0.855s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:17 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack sudo[94487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2 Sep 17 15:05:17 devstack sudo[94487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Created reservations ['59b0841e-88ba-43ff-8302-44a80a09b870', '0a395438-b680-4cf5-b8fc-45967107ce47', '65eec7c3-e665-42c6-ad9f-3ed38cc5a913', '2de41f3c-a095-4f8b-8f01-633a830e2b78'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:17 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:17 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:17 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:17 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info Sep 17 15:05:17 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-cb847372-bbfa-4a0b-85d5-f9282df64110-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "cinder-cb847372-bbfa-4a0b-85d5-f9282df64110-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:18 devstack sudo[94487]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e840e393-d28e-4f4f-a39f-effc6d292df2" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b825e4-ce4e-40f2-9af7-f8e5a40f74bc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-e840e393-d28e-4f4f-a39f-effc6d292df2" released by "delete_volume" :: held 1.147s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:18 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:18 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info is being set with open permissions: ugo+rw Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:05:18 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info Sep 17 15:05:18 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-385913ab-71a3-40c1-b096-a822076e8457 tempest-VolumesGetTest-996746258 None] Lock "cinder-9793a875-6936-447b-b091-8dfa14e150d7-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:18 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 Sep 17 15:05:18 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Created reservations ['bbca00f0-02d5-4a53-a0d0-f762316dfaec', '603b5395-6d6e-4184-a611-da09d6b4dcdc', 'ae2a96ad-8919-40b7-9fb9-4d63ae5f0c68', 'd82c99fc-f1e3-4cd9-a2fa-a64696315a60'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:18 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:18 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:18 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.info" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.786s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:18 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:18 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110 Sep 17 15:05:18 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-89253852-f9c7-484a-8961-f2488ec60f60 tempest-SnapshotsActionsTest-1909073258 None] Create snapshot completed successfully Sep 17 15:05:18 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Deleted volume successfully. Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1642cc78-65d5-41a4-8aba-3cd7dfd5a539 tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-e840e393-d28e-4f4f-a39f-effc6d292df2-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:18 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-cb847372-bbfa-4a0b-85d5-f9282df64110" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-cb847372-bbfa-4a0b-85d5-f9282df64110" released by "delete_volume" :: held 0.788s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Created reservations ['88d2d281-a13c-4f76-b02e-74f9e62ae0d1', '67409013-fed5-4b0e-a60a-e3fd064a773d', '5fd83bff-8503-4ed2-9847-585d68c85df7', '76c163de-0db1-4c8e-91ca-3bcedce453cc'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:19 devstack sudo[94511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:19 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-a489f08b-caf6-416d-8db2-b3ea920302be-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-a489f08b-caf6-416d-8db2-b3ea920302be-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6dec8a-77bb-4d0a-b346-94af0821c0cb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:19 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b696d55c-b6c5-4645-bd70-843c4159bd79 tempest-VolumesGetTest-996746258 None] Lock "cinder-cb847372-bbfa-4a0b-85d5-f9282df64110-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:19 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be Sep 17 15:05:19 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "cinder-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55df630-90d1-4bbf-8f61-d43b170475c8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:19 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:05:19 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:19 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:20 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Creating offline snapshot 3065c356-d5fe-4a36-8a86-ec1ccb7817a0 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:20 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d72beb-30b9-438c-8dff-844505dc997d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[94523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:20 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3 Sep 17 15:05:20 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a489f08b-caf6-416d-8db2-b3ea920302be" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-quobyte-a489f08b-caf6-416d-8db2-b3ea920302be" released by "delete_volume" :: held 0.984s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Created reservations ['e6601ffc-fe6e-4222-9ac6-c3feba1c4412', 'a29ae62f-d1f9-4051-85ca-7a27766a1111', 'b50fdbca-fa60-44b6-9429-3ffced259324', 'da33da3d-92cd-44cf-812c-699973e5be5c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.561s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:20 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3" released by "delete_volume" :: held 0.983s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:20 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 1G Sep 17 15:05:20 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Created reservations ['a38c9cb0-562c-4921-bb2f-aca27ac23b7f', '3b7e2971-4392-4a10-a3c8-835339e00f7b', '1c5bfadc-e55b-4028-8abe-b81322de7c9d', 'a89572d1-20cd-4aa1-bd3c-a04b5de16bfb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:20 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:20 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:20 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:20 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Deleted volume successfully. Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-76bb58d8-0cb3-4da6-b39a-e57e1900cebd tempest-VolumesDeleteCascade-274568745 None] Lock "cinder-a489f08b-caf6-416d-8db2-b3ea920302be-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:21 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b059e7b-f569-4474-981a-71b661bd1e05 tempest-VolumesGetTest-996746258 None] Lock "cinder-f370a0e2-a906-4dad-ba3e-a3b538a9c4f3-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:21 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 1G" returned: 0 in 0.594s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 Sep 17 15:05:21 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 is being set with open permissions: ugo+rw Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:21 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 Sep 17 15:05:21 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:21 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.903s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4d41c0e1-08c3-4715-b485-d73c04da6583 tempest-SnapshotsActionsTest-1909073258 None] Create snapshot completed successfully Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-3065c356-d5fe-4a36-8a86-ec1ccb7817a0-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-3065c356-d5fe-4a36-8a86-ec1ccb7817a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-3065c356-d5fe-4a36-8a86-ec1ccb7817a0" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-3065c356-d5fe-4a36-8a86-ec1ccb7817a0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Deleting offline snapshot 3065c356-d5fe-4a36-8a86-ec1ccb7817a0 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] snapshot_file for this snap is: volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770a8d0-0404-414a-8389-381b3b4f6ee0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:22 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 Sep 17 15:05:22 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6789a5-ac6f-4177-a8ef-b47d1a6a90df]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (3a32f240-b604-4be8-a901-d6dd6227b81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91271331-3e06-43e3-835b-5402203d332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91271331-3e06-43e3-835b-5402203d332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584701507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01b9511-6698-42f0-b8e9-e4cfe03f9d7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:23Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c669e-6733-4a0b-991d-dec8d8ac0241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65c669e-6733-4a0b-991d-dec8d8ac0241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71915d99-6ea6-4e47-9c96-822a097401f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:05:23 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:23 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.610s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:23 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 Sep 17 15:05:23 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71915d99-6ea6-4e47-9c96-822a097401f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e01b9511-6698-42f0-b8e9-e4cfe03f9d7b', 'volume_name': 'volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473cba18-ee85-4d5c-9bba-7987e0c8db15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (473cba18-ee85-4d5c-9bba-7987e0c8db15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f0090-6988-482f-af36-f462510c7946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:05:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Trying to clone e01b9511-6698-42f0-b8e9-e4cfe03f9d7b from image 8d02878c-b12d-4421-bc53-544f1bf812dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:05:24 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9dae53-0939-430a-8996-11d3cd2dcdf9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:24 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0" returned: 0 in 0.662s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:24 devstack sudo[94575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0 Sep 17 15:05:24 devstack sudo[94575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:24 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD Sep 17 15:05:24 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:24 devstack sudo[94575]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.3065c356-d5fe-4a36-8a86-ec1ccb7817a0" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-3065c356-d5fe-4a36-8a86-ec1ccb7817a0" released by "_delete_snapshot" :: held 2.305s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_snapshot" :: held 2.335s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:24 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd is fetched for user 1bdb53f7132d471e8729e27baa69bbfc. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Created reservations ['2b02f4e8-e290-40f7-a406-bc034404ebd8', '218648aa-0dc0-4ea2-830d-abd8db88c346', '58330139-5c25-4154-b942-eaab0ce96368', '0c75daad-28a1-49bd-ad6f-bf6e93afbf5a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2668f476-1547-40ea-9c4c-92cad66f18d6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Delete snapshot completed successfully. Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f45260bf-3454-4add-8e4f-45e766015b41 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-3065c356-d5fe-4a36-8a86-ec1ccb7817a0-delete_snapshot" released by "delete_snapshot" :: held 2.589s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:25 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD Sep 17 15:05:25 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1584701507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01b9511-6698-42f0-b8e9-e4cfe03f9d7b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:23Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Creating volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:25 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1073741824 Sep 17 15:05:25 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:25 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1073741824" returned: 0 in 0.579s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[94596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b Sep 17 15:05:26 devstack sudo[94596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:26 devstack sudo[94596]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.247s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Creating offline snapshot aeac8d09-4429-45f3-ae0f-31bc326ef70a of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Attempting download of 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8def702d-8862-42cf-94d9-54457e4dc098]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ec629-e562-4e12-b06d-ba61e3fe5b9d]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:26 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9 Sep 17 15:05:26 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:26 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:26 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a 1G Sep 17 15:05:26 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9 Sep 17 15:05:27 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9" returned: 1 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_njfm8hv9' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9aa483-84b5-48bc-a1b5-b48f592c6675]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD Sep 17 15:05:27 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a 1G" returned: 0 in 0.611s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a Sep 17 15:05:27 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] 8d02878c-b12d-4421-bc53-544f1bf812dd was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:27 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b Sep 17 15:05:27 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:27 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a" returned: 0 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:27 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a is being set with open permissions: ugo+rw Sep 17 15:05:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a Sep 17 15:05:28 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:28 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-005fe648-aa60-41d8-9dff-638392e34e28 tempest-SnapshotsActionsTest-1909073258 None] Create snapshot completed successfully Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Flow 'volume_create_manager' (bca013b8-5944-4f65-bc4f-1957a0f15e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74afb1e7-b3f3-4762-9a05-de6b11767a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74afb1e7-b3f3-4762-9a05-de6b11767a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1087029442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f123935b-935f-4b2f-bfb0-7ba94310f9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0c2896563746aaaa28e79a78452198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:28Z,use_quota=True,user_id='1c0662c2de7b464f927f40ea5e9ec10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc80432-c5a9-4fed-8c1c-ea9cc957a446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc80432-c5a9-4fed-8c1c-ea9cc957a446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99c72c6-5e88-4857-aa53-03a4b99d3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d99c72c6-5e88-4857-aa53-03a4b99d3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f123935b-935f-4b2f-bfb0-7ba94310f9ca', 'volume_name': 'volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff1b61b-ee4c-4716-9694-a99d044a1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff1b61b-ee4c-4716-9694-a99d044a1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606cb90-7c94-4191-97c3-026af4f72279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Volume f123935b-935f-4b2f-bfb0-7ba94310f9ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca', 'volume_size': 1} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1087029442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f123935b-935f-4b2f-bfb0-7ba94310f9ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0c2896563746aaaa28e79a78452198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:28Z,use_quota=True,user_id='1c0662c2de7b464f927f40ea5e9ec10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Creating volume f123935b-935f-4b2f-bfb0-7ba94310f9ca {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:28 devstack sudo[94638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca 1073741824 Sep 17 15:05:28 devstack sudo[94638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack sudo[94638]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca 1073741824" returned: 0 in 0.746s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:29 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca Sep 17 15:05:29 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-aeac8d09-4429-45f3-ae0f-31bc326ef70a-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-aeac8d09-4429-45f3-ae0f-31bc326ef70a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-aeac8d09-4429-45f3-ae0f-31bc326ef70a" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-aeac8d09-4429-45f3-ae0f-31bc326ef70a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Deleting offline snapshot aeac8d09-4429-45f3-ae0f-31bc326ef70a of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] snapshot_file for this snap is: volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c122659a-2d98-40b6-8e1b-63a0f92f00ce]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:29 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a Sep 17 15:05:29 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:29 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8606cb90-7c94-4191-97c3-026af4f72279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7034827-c860-4817-bceb-5226439ca771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Volume volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca (f123935b-935f-4b2f-bfb0-7ba94310f9ca): created successfully Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7034827-c860-4817-bceb-5226439ca771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Flow 'volume_create_manager' (bca013b8-5944-4f65-bc4f-1957a0f15e83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-84a1089b-d9d3-4da0-8518-9535104e72c9 tempest-VolumesTransfersV355Test-1240838040 None] Created volume successfully. Sep 17 15:05:30 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b65a18-f497-4532-b6d9-22dd457d67f5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:30 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:30 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" returned: 0 in 2.601s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_shhmqyuadevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:05:30 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Converted 112.00 MB image at 43.05 MB/s Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack sudo[94657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1G Sep 17 15:05:30 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:30 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:30 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a Sep 17 15:05:30 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:30 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b 1G" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Downloaded image 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd for user 1bdb53f7132d471e8729e27baa69bbfc is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Marking volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Copying metadata from image 8d02878c-b12d-4421-bc53-544f1bf812dd to e01b9511-6698-42f0-b8e9-e4cfe03f9d7b. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Creating volume glance metadata for volume e01b9511-6698-42f0-b8e9-e4cfe03f9d7b backed by image 8d02878c-b12d-4421-bc53-544f1bf812dd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:DELETE=15,cinder:SELECT=131,cinder:UPDATE=173,cinder:INSERT=42 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420f0090-6988-482f-af36-f462510c7946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4fc92-702c-4173-b6a9-ee3871f5dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Volume volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b (e01b9511-6698-42f0-b8e9-e4cfe03f9d7b): created successfully Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc4fc92-702c-4173-b6a9-ee3871f5dc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (3a32f240-b604-4be8-a901-d6dd6227b81b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-23fe755b-3d10-44e8-bf74-6c2d03d0d5ef tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:05:31 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:31 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a Sep 17 15:05:31 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:31 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.aeac8d09-4429-45f3-ae0f-31bc326ef70a" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-aeac8d09-4429-45f3-ae0f-31bc326ef70a" released by "_delete_snapshot" :: held 1.876s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_snapshot" :: held 1.907s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=152,cinder:INSERT=52,cinder:UPDATE=166,cinder:DELETE=11 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Created reservations ['458909c9-4c90-46f6-8862-cbe8ffd7200a', '1a0fd79f-272f-4cec-ac5c-df2065f76873', '6c2fafb0-5aad-426e-85c7-21b34ff3ed04', '91753082-274a-4310-a9a6-50c1b5a0100d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Delete snapshot completed successfully. Sep 17 15:05:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-89ae4fa4-3317-4853-8cef-2633781f8d0c tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-aeac8d09-4429-45f3-ae0f-31bc326ef70a-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2a716a7-8fbb-4a4b-972b-21edfd5ff783 tempest-VolumesTransfersV355Test-2048340239 None] Transfer volume completed successfully. Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Creating offline snapshot 92903b9c-7241-4d78-9545-9af60bf6b548 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[299e9a10-9fa7-4171-b42e-4a935974b222]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:32 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:32 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "cinder-f123935b-935f-4b2f-bfb0-7ba94310f9ca-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-f123935b-935f-4b2f-bfb0-7ba94310f9ca-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "cinder-quobyte-f123935b-935f-4b2f-bfb0-7ba94310f9ca" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-quobyte-f123935b-935f-4b2f-bfb0-7ba94310f9ca" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad944cc1-fc2e-4778-aa5b-baa18f1bb327]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (e38454c1-db05-4b43-8857-635a748cf6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233325c9-fa57-46d6-afc6-e4ffc487c3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233325c9-fa57-46d6-afc6-e4ffc487c3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1995620354',display_name='tempest-VolumesGetTest-Volume-1739009279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b651b35-93d6-4cfe-a8b9-0871ef3123a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:33Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2472c87-22c4-4c44-8019-369a00c4f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2472c87-22c4-4c44-8019-369a00c4f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91e495e-0eba-4fa1-a01c-56570541952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e91e495e-0eba-4fa1-a01c-56570541952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b651b35-93d6-4cfe-a8b9-0871ef3123a6', 'volume_name': 'volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b14612a-f8b3-4f5b-b427-de735de83c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b14612a-f8b3-4f5b-b427-de735de83c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:33 devstack sudo[94679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca Sep 17 15:05:33 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcecceb5-9f36-44de-8838-0f5780db3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Volume 5b651b35-93d6-4cfe-a8b9-0871ef3123a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6', 'volume_size': 1} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:33 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.576s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 1G Sep 17 15:05:33 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca Sep 17 15:05:33 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 1G" returned: 0 in 0.546s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 Sep 17 15:05:33 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:33 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f123935b-935f-4b2f-bfb0-7ba94310f9ca" returned: 0 in 0.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-quobyte-f123935b-935f-4b2f-bfb0-7ba94310f9ca" released by "delete_volume" :: held 0.852s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Created reservations ['32aeb686-0450-499c-92f9-f7fb9412eb49', 'd34ae371-1ac3-48d7-9d9b-463c8f888c2e', 'ff75511d-d1b9-468a-80c6-790894b68e7a', '17afce44-6032-4ad1-8ea7-3e7aae9762cd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:33 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:33 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 is being set with open permissions: ugo+rw Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:34 devstack sudo[94704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 Sep 17 15:05:34 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Deleted volume successfully. Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0c260e7b-fae4-4b50-a6ed-fa7a5768e0b4 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-f123935b-935f-4b2f-bfb0-7ba94310f9ca-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:34 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.128s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.450s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1995620354',display_name='tempest-VolumesGetTest-Volume-1739009279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b651b35-93d6-4cfe-a8b9-0871ef3123a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e84cecb1e044c7b8a9fd1060eb3840d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:33Z,use_quota=True,user_id='1bdb53f7132d471e8729e27baa69bbfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Creating volume 5b651b35-93d6-4cfe-a8b9-0871ef3123a6 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:34 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 1073741824 Sep 17 15:05:34 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4a5816f0-c635-4d5d-b5af-6c5dfc38eac8 tempest-SnapshotsActionsTest-1909073258 None] Create snapshot completed successfully Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Flow 'volume_create_manager' (82793f82-c94e-4807-94c3-416895b1ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdcd4fb-2d08-48d6-8f86-2dfb438aba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdcd4fb-2d08-48d6-8f86-2dfb438aba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1288410214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0047dcf-21f7-45fc-b007-8f59b467e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0c2896563746aaaa28e79a78452198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:35Z,use_quota=True,user_id='1c0662c2de7b464f927f40ea5e9ec10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f0f3e-b27b-46f2-9a18-30f1eeef7e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567f0f3e-b27b-46f2-9a18-30f1eeef7e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce167536-341a-433d-9f9b-58ed43b504e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce167536-341a-433d-9f9b-58ed43b504e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0047dcf-21f7-45fc-b007-8f59b467e178', 'volume_name': 'volume-f0047dcf-21f7-45fc-b007-8f59b467e178', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcd700-5a5e-4d05-8650-f2e52265b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcd700-5a5e-4d05-8650-f2e52265b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1402d3d-3404-4d29-a2c6-5275d333bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Volume f0047dcf-21f7-45fc-b007-8f59b467e178: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0047dcf-21f7-45fc-b007-8f59b467e178', 'volume_size': 1} Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:34 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 1073741824" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 Sep 17 15:05:35 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" returned: 0 in 0.355s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1288410214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0047dcf-21f7-45fc-b007-8f59b467e178,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e0c2896563746aaaa28e79a78452198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:35Z,use_quota=True,user_id='1c0662c2de7b464f927f40ea5e9ec10b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Creating volume f0047dcf-21f7-45fc-b007-8f59b467e178 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[94716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 1073741824 Sep 17 15:05:35 devstack sudo[94716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcecceb5-9f36-44de-8838-0f5780db3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe2c0a2-0938-4f41-81ba-85671a979b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Volume volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 (5b651b35-93d6-4cfe-a8b9-0871ef3123a6): created successfully Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe2c0a2-0938-4f41-81ba-85671a979b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Flow 'volume_create_manager' (e38454c1-db05-4b43-8857-635a748cf6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-41db51d4-94fb-4323-acf3-b20de19d83b6 tempest-VolumesGetTest-996746258 None] Created volume successfully. Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-92903b9c-7241-4d78-9545-9af60bf6b548-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-92903b9c-7241-4d78-9545-9af60bf6b548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-92903b9c-7241-4d78-9545-9af60bf6b548" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-92903b9c-7241-4d78-9545-9af60bf6b548" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Deleting offline snapshot 92903b9c-7241-4d78-9545-9af60bf6b548 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] snapshot_file for this snap is: volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07723d96-d970-4bbf-98d6-54037e5c2ed7]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:35 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 Sep 17 15:05:35 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:35 devstack sudo[94716]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 1073741824" returned: 0 in 0.566s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:36 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 Sep 17 15:05:36 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:36 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178" returned: 0 in 0.308s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1402d3d-3404-4d29-a2c6-5275d333bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0047dcf-21f7-45fc-b007-8f59b467e178', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70927d90-f580-42fd-aa86-6250b90f795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:36 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Volume volume-f0047dcf-21f7-45fc-b007-8f59b467e178 (f0047dcf-21f7-45fc-b007-8f59b467e178): created successfully Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70927d90-f580-42fd-aa86-6250b90f795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Flow 'volume_create_manager' (82793f82-c94e-4807-94c3-416895b1ac75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c9784c-a4d4-4dc6-aa50-d164cb9e5b0e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-5b651b35-93d6-4cfe-a8b9-0871ef3123a6-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a00dd9e2-fdcc-4792-ab0f-82dee4a54e74 tempest-VolumesTransfersV355Test-1240838040 None] Created volume successfully. Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "cinder-5b651b35-93d6-4cfe-a8b9-0871ef3123a6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e01282-fe7e-4519-b621-f77cf5515f3f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:36 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:36 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:36 devstack sudo[94731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 Sep 17 15:05:36 devstack sudo[94731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.613s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 Sep 17 15:05:37 devstack sudo[94739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "cinder-f0047dcf-21f7-45fc-b007-8f59b467e178-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:37 devstack sudo[94731]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-f0047dcf-21f7-45fc-b007-8f59b467e178-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" returned: 0 in 0.635s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6 Sep 17 15:05:37 devstack sudo[94743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "cinder-quobyte-f0047dcf-21f7-45fc-b007-8f59b467e178" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-quobyte-f0047dcf-21f7-45fc-b007-8f59b467e178" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe3367-8c79-40b0-946a-17246fac1a16]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 Sep 17 15:05:37 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack sudo[94743]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" returned: 0 in 0.305s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-5b651b35-93d6-4cfe-a8b9-0871ef3123a6" released by "delete_volume" :: held 0.983s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Created reservations ['608f8744-70e7-42e1-ac55-eac9fefcc21a', 'd6df05c3-e92c-4e18-a397-bdd5c37ea54a', 'ae5270b1-fef8-4c09-944c-27caeb0fcf61', '2f17c439-ef58-47d8-b0bd-33210cd22fb7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:37 devstack sudo[94739]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548" returned: 0 in 0.577s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548 Sep 17 15:05:37 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:37 devstack sudo[94755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178" returned: 0 in 0.591s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:37 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178 Sep 17 15:05:37 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:37 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.92903b9c-7241-4d78-9545-9af60bf6b548" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-92903b9c-7241-4d78-9545-9af60bf6b548" released by "_delete_snapshot" :: held 2.229s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_snapshot" :: held 2.269s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack sudo[94755]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Created reservations ['2f1a75ce-222c-4cf6-b4df-71842f28cde5', '58c287a5-6528-499d-b85d-694e0b693dd7', 'c7e8605f-d625-4af5-9e97-997ea65561ac', 'e19016cd-9e3b-4544-ac9c-7c30b141c208'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-61f310e6-37cc-42ce-83f3-5f57370d39f1 tempest-VolumesGetTest-996746258 None] Lock "cinder-5b651b35-93d6-4cfe-a8b9-0871ef3123a6-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Delete snapshot completed successfully. Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f943494e-9a63-42d8-82e4-60eb2da73f87 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-92903b9c-7241-4d78-9545-9af60bf6b548-delete_snapshot" released by "delete_snapshot" :: held 2.464s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f0047dcf-21f7-45fc-b007-8f59b467e178" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-quobyte-f0047dcf-21f7-45fc-b007-8f59b467e178" released by "delete_volume" :: held 1.014s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Created reservations ['1397ca33-0faf-4238-b5eb-fc3005261fcd', '2537d3a9-3ccf-4adc-bfd9-01aca8faab06', '77ac14ea-e020-42b2-990e-1c55951bd5e8', '28cbef69-0aea-40f7-8c24-3f3a8adf010b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:38 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:38 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:38 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Deleted volume successfully. Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a7fb6db2-7ce1-46ee-9b88-a73419a5f652 tempest-VolumesTransfersV355Test-1191839164 None] Lock "cinder-f0047dcf-21f7-45fc-b007-8f59b467e178-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "cinder-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Acquiring lock "cinder-quobyte-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce65c92-d35f-454b-a93a-09c1366acc44]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:39 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b Sep 17 15:05:39 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Creating offline snapshot 5ce10007-395a-40e4-9707-8f5322939663 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385c22c-c6cf-4b5d-a0c4-011dec2d85ee]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:39 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:39 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b Sep 17 15:05:39 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:39 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:39 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:39 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "cinder-quobyte-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b" released by "delete_volume" :: held 0.955s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:39 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Created reservations ['b4a84909-773c-404f-8363-104fa0bf2596', '35991670-251b-45d6-b86c-9ced0fe2276e', '3bfb9777-c60b-4f50-9700-86b203c3649a', '2e126929-1dce-435b-9305-2f052cde55f9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:40 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 1G Sep 17 15:05:40 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:40 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:40 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:40 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Deleted volume successfully. Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c1214035-c4a6-40d8-a524-786255283dd0 tempest-VolumesGetTest-996746258 None] Lock "cinder-e01b9511-6698-42f0-b8e9-e4cfe03f9d7b-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:40 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 1G" returned: 0 in 0.731s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:40 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 Sep 17 15:05:40 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:41 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663" returned: 0 in 0.366s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:41 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 is being set with open permissions: ugo+rw Sep 17 15:05:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:41 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 Sep 17 15:05:41 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:41 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-781c9170-f9e1-458b-8cc2-b913a827982b tempest-SnapshotsActionsTest-1909073258 None] Create snapshot completed successfully Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-5ce10007-395a-40e4-9707-8f5322939663-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-5ce10007-395a-40e4-9707-8f5322939663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Acquiring lock "cinder-quobyte-5ce10007-395a-40e4-9707-8f5322939663" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-5ce10007-395a-40e4-9707-8f5322939663" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Deleting offline snapshot 5ce10007-395a-40e4-9707-8f5322939663 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] snapshot_file for this snap is: volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00dea4e-b0e6-48e5-9014-f4491d3de2c0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:42 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 Sep 17 15:05:42 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:43 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663" returned: 0 in 0.457s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76fac4e-8833-47f2-8084-a40ab927a570]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:43 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:43 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:43 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:43 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 Sep 17 15:05:43 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663" returned: 0 in 0.571s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:44 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663 Sep 17 15:05:44 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:44 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.5ce10007-395a-40e4-9707-8f5322939663" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-5ce10007-395a-40e4-9707-8f5322939663" released by "_delete_snapshot" :: held 2.050s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_snapshot" :: held 2.087s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Created reservations ['5523b544-3410-4459-9a33-db9e90355b7e', '19954c8a-6702-4c3b-967d-30f18562a75b', 'ce066a56-835c-4308-9983-d2946d89488c', '7e697d76-d58a-4335-a5ee-809e66f8a72f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Delete snapshot completed successfully. Sep 17 15:05:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-80872d34-42b1-4152-84f5-025e38d656c5 tempest-SnapshotsActionsTest-204151884 None] Lock "cinder-5ce10007-395a-40e4-9707-8f5322939663-delete_snapshot" released by "delete_snapshot" :: held 2.294s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "cinder-fdbcebb6-9844-4d04-b8d0-f80d09b927d6-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-fdbcebb6-9844-4d04-b8d0-f80d09b927d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_snapshot" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "cinder-quobyte-fdbcebb6-9844-4d04-b8d0-f80d09b927d6" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-fdbcebb6-9844-4d04-b8d0-f80d09b927d6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Deleting offline snapshot fdbcebb6-9844-4d04-b8d0-f80d09b927d6 of volume 01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] snapshot_file for this snap is: volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a631eba5-ab1d-4f38-b5a1-d986df3d6b6a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:46 devstack sudo[94876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:46 devstack sudo[94876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[94876]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.537s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e8b17d-8625-4a46-a432-47d74fb3918a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d57faa-82ec-40db-92b5-e99949db8910]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:47 devstack sudo[94884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Flow 'volume_create_manager' (7df792bc-eafd-401d-aeba-bebe7af70214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:47 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3436bf-829e-45e4-bac2-fb860d0c9b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a3436bf-829e-45e4-bac2-fb860d0c9b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-803051837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b01294-08d0-4fe5-9854-3e394f630cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414bea80b90b409599360eb620ad626c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:47Z,use_quota=True,user_id='f9840153533e4e1488b09c3729d8a8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0e1c7b-a887-47a2-8d0c-1f64abadc849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0e1c7b-a887-47a2-8d0c-1f64abadc849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8919309-63d0-4d84-9f36-860720002b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8919309-63d0-4d84-9f36-860720002b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b01294-08d0-4fe5-9854-3e394f630cc9', 'volume_name': 'volume-c8b01294-08d0-4fe5-9854-3e394f630cc9', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ded98d-e3ce-4f56-a1dd-4f049561d71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ded98d-e3ce-4f56-a1dd-4f049561d71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb1bb45-5aea-4824-9db6-0f4a540c6e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Volume c8b01294-08d0-4fe5-9854-3e394f630cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b01294-08d0-4fe5-9854-3e394f630cc9', 'volume_size': 2} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-803051837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b01294-08d0-4fe5-9854-3e394f630cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414bea80b90b409599360eb620ad626c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:47Z,use_quota=True,user_id='f9840153533e4e1488b09c3729d8a8a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Creating volume c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:47 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 2147483648 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 2147483648 Sep 17 15:05:47 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:47 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a" returned: 0 in 0.531s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:47 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:48 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:48 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 2147483648" returned: 0 in 0.748s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:48 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:48 devstack sudo[94900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 Sep 17 15:05:48 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:48 devstack sudo[94901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6 Sep 17 15:05:48 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:48 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb1bb45-5aea-4824-9db6-0f4a540c6e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b01294-08d0-4fe5-9854-3e394f630cc9', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e3d220-a9f7-4b79-96a9-db9ab113df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Volume volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 (c8b01294-08d0-4fe5-9854-3e394f630cc9): created successfully Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e3d220-a9f7-4b79-96a9-db9ab113df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Flow 'volume_create_manager' (7df792bc-eafd-401d-aeba-bebe7af70214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-54a65815-18f2-4b11-87e5-0afcdd9d0d7c tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Created volume successfully. Sep 17 15:05:48 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a.fdbcebb6-9844-4d04-b8d0-f80d09b927d6" returned: 0 in 0.387s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-fdbcebb6-9844-4d04-b8d0-f80d09b927d6" released by "_delete_snapshot" :: held 2.223s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_snapshot" :: held 2.261s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:49 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Created reservations ['461b48f6-301a-4cf4-a7fe-2cba1787aa7e', '361eb3f1-f4ec-489b-9a74-e406ecc6f5f5', '89a7bbab-e503-4ca6-b9fc-3ba5a77783e2', '81563bd2-89bf-451d-b3ea-4ef5c37ec3de'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Delete snapshot completed successfully. Sep 17 15:05:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8423b2ad-20a9-49dd-ad5c-4c28094e57bc tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-fdbcebb6-9844-4d04-b8d0-f80d09b927d6-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "cinder-01e8b17d-8625-4a46-a432-47d74fb3918a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-01e8b17d-8625-4a46-a432-47d74fb3918a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Creating offline snapshot 0139e448-0dad-44d7-b617-36d500969668 of volume c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e4a375-a9db-4749-bcff-a404feee184f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d1768e-caa0-4a92-ba52-b22136cb19b9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:50 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a Sep 17 15:05:50 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:50 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 Sep 17 15:05:50 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:51 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a" returned: 0 in 0.727s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:51 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a Sep 17 15:05:51 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:51 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9" returned: 0 in 0.814s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 2G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:51 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 2G Sep 17 15:05:51 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:51 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-01e8b17d-8625-4a46-a432-47d74fb3918a" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-quobyte-01e8b17d-8625-4a46-a432-47d74fb3918a" released by "delete_volume" :: held 1.301s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Created reservations ['3683894f-4f4a-4f29-b2ed-0f9d9071ba28', '8823308d-6bd3-4d1c-ab32-f78d06426d6c', '1e565e75-c1ef-4630-9e68-55116b0d5a4c', '68ea932d-60ce-4fdb-b40b-85bc75d98b56'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:51 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:51 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:52 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 2G" returned: 0 in 0.786s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:52 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 Sep 17 15:05:52 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:52 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Deleted volume successfully. Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eb235041-93c1-4f88-b493-79417be9438c tempest-SnapshotsActionsTest-1909073258 None] Lock "cinder-01e8b17d-8625-4a46-a432-47d74fb3918a-delete_volume" released by "delete_volume" :: held 2.062s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:52 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Flow 'volume_create_manager' (0ead0f6f-7158-408b-a31f-bcc789d982e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ceaa6d-4f67-4ec6-b265-c6291e2c7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:52 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 is being set with open permissions: ugo+rw Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ceaa6d-4f67-4ec6-b265-c6291e2c7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-814283815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba92ada-dd60-497b-aff1-87b1c640edc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414f79a35e0498695b4d9ee321421b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:52Z,use_quota=True,user_id='d44ed6bd6fcd431390fdcbcac10f65f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:52 devstack sudo[95010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 Sep 17 15:05:52 devstack sudo[95010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cad44b-971c-4309-bda2-68d7567be622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cad44b-971c-4309-bda2-68d7567be622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15710d0f-da46-4cba-910c-1229b3ab5729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15710d0f-da46-4cba-910c-1229b3ab5729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba92ada-dd60-497b-aff1-87b1c640edc9', 'volume_name': 'volume-5ba92ada-dd60-497b-aff1-87b1c640edc9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad62e2b-2490-417d-9d33-ec66f068363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad62e2b-2490-417d-9d33-ec66f068363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105b378-9f6b-4549-a2e2-2439a70ba87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Volume 5ba92ada-dd60-497b-aff1-87b1c640edc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba92ada-dd60-497b-aff1-87b1c640edc9', 'volume_size': 1} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:52 devstack sudo[95010]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:52 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info Sep 17 15:05:52 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info" returned: 0 in 0.464s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info is being set with open permissions: ugo+rw Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info Sep 17 15:05:53 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (988fc0af-d8ba-4860-be75-02957b245899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9041bc6c-b3f3-4af7-81db-661fc5fe298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9041bc6c-b3f3-4af7-81db-661fc5fe298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1428401156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737658e0-bfa6-4fbe-aaf5-92aef8507192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:53Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcda585c-1b98-4e41-a2f7-225884ace2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcda585c-1b98-4e41-a2f7-225884ace2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98469cb4-a5de-4255-80f6-45fb1a52995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98469cb4-a5de-4255-80f6-45fb1a52995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '737658e0-bfa6-4fbe-aaf5-92aef8507192', 'volume_name': 'volume-737658e0-bfa6-4fbe-aaf5-92aef8507192', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27007f06-eaf9-43c8-b949-5731bd7bb826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27007f06-eaf9-43c8-b949-5731bd7bb826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bad4a06-cf7c-4308-aed8-8fef686dcd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Volume 737658e0-bfa6-4fbe-aaf5-92aef8507192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-737658e0-bfa6-4fbe-aaf5-92aef8507192', 'volume_size': 1} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:53 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.info" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.464s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.086s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-814283815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba92ada-dd60-497b-aff1-87b1c640edc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414f79a35e0498695b4d9ee321421b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:52Z,use_quota=True,user_id='d44ed6bd6fcd431390fdcbcac10f65f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Creating volume 5ba92ada-dd60-497b-aff1-87b1c640edc9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:53 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:53 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 1073741824 Sep 17 15:05:53 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3a723d7c-0f48-4e14-9bb8-93600f194756 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Create snapshot completed successfully Sep 17 15:05:54 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 1073741824" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 Sep 17 15:05:54 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9" returned: 0 in 0.378s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.094s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:05:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1428401156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=737658e0-bfa6-4fbe-aaf5-92aef8507192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:05:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:05:53Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Creating volume 737658e0-bfa6-4fbe-aaf5-92aef8507192 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:05:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "cinder-0139e448-0dad-44d7-b617-36d500969668-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:54 devstack sudo[95027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 1073741824 Sep 17 15:05:54 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0105b378-9f6b-4549-a2e2-2439a70ba87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba92ada-dd60-497b-aff1-87b1c640edc9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718955d-673c-4544-be64-e7aca68fd57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Volume volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 (5ba92ada-dd60-497b-aff1-87b1c640edc9): created successfully Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e718955d-673c-4544-be64-e7aca68fd57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Flow 'volume_create_manager' (0ead0f6f-7158-408b-a31f-bcc789d982e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-0139e448-0dad-44d7-b617-36d500969668-delete_snapshot" acquired by "delete_snapshot" :: waited 0.086s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:54 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6abd932b-e2d2-4715-b3e6-56ce3d542e6a tempest-VolumesTransfersV357Test-78823852 None] Created volume successfully. Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" acquired by "delete_snapshot" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "cinder-quobyte-0139e448-0dad-44d7-b617-36d500969668" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-0139e448-0dad-44d7-b617-36d500969668" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Deleting offline snapshot 0139e448-0dad-44d7-b617-36d500969668 of volume c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] snapshot_file for this snap is: volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[499552a5-9006-4418-a423-9eaed1c14492]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:55 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 Sep 17 15:05:55 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:55 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 1073741824" returned: 0 in 0.621s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:55 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 Sep 17 15:05:55 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:55 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668" returned: 0 in 0.628s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8b01294-08d0-4fe5-9854-3e394f630cc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f347d7-e170-4ca0-94e5-323c893decbc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:55 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192" returned: 0 in 0.347s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bad4a06-cf7c-4308-aed8-8fef686dcd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-737658e0-bfa6-4fbe-aaf5-92aef8507192', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b1af2-c256-45c9-b8c6-d9a384748ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:05:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Volume volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 (737658e0-bfa6-4fbe-aaf5-92aef8507192): created successfully Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57b1af2-c256-45c9-b8c6-d9a384748ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:05:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (988fc0af-d8ba-4860-be75-02957b245899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:05:55 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 Sep 17 15:05:55 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-29b54233-1083-40cc-8052-a872395f93fb tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:05:56 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9" returned: 0 in 0.564s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:56 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 Sep 17 15:05:56 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:56 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668" returned: 0 in 0.572s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db3bc9c2-b645-4aca-bc17-58847048d828 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:56 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668 Sep 17 15:05:56 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db3bc9c2-b645-4aca-bc17-58847048d828 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192" acquired by "attach_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:05:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:57 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:05:57 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-db3bc9c2-b645-4aca-bc17-58847048d828 tempest-VolumesActionsTest-1895420370 None] Attaching volume 737658e0-bfa6-4fbe-aaf5-92aef8507192 to instance 98a00f1c-3502-4eb3-887b-3c8a3dea2095 at mountpoint /dev/vdb on host None. Sep 17 15:05:57 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9.0139e448-0dad-44d7-b617-36d500969668" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-db3bc9c2-b645-4aca-bc17-58847048d828 tempest-VolumesActionsTest-1895420370 None] Attach volume completed successfully. Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-0139e448-0dad-44d7-b617-36d500969668" released by "_delete_snapshot" :: held 2.385s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-db3bc9c2-b645-4aca-bc17-58847048d828 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192" released by "attach_volume" :: held 0.419s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" released by "delete_snapshot" :: held 2.431s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Created reservations ['b70107ae-6ab0-441a-9380-38d12feb5aff', 'c2133067-ae26-43a7-a3a1-d28b68cd3aa5', '60f09254-cd0d-4b93-a774-bc96d9cb48f3', '1326a9ba-601c-4568-a47d-afcc2be550a6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:05:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-09a9a87f-8a40-4cbf-9dc6-03ab51e5a802 tempest-VolumesTransfersV357Test-1217087801 None] Transfer volume completed successfully. Sep 17 15:05:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Delete snapshot completed successfully. Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a86d8f7b-7b94-455f-8c57-5ea69cf4dd34 tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-0139e448-0dad-44d7-b617-36d500969668-delete_snapshot" released by "delete_snapshot" :: held 2.822s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:57 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.659s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:05:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "cinder-5ba92ada-dd60-497b-aff1-87b1c640edc9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-5ba92ada-dd60-497b-aff1-87b1c640edc9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Terminate volume connection completed successfully. Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "cinder-quobyte-5ba92ada-dd60-497b-aff1-87b1c640edc9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-quobyte-5ba92ada-dd60-497b-aff1-87b1c640edc9" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07224fd3-d732-40e6-9f27-bca693dd9c1a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Detaching volume 737658e0-bfa6-4fbe-aaf5-92aef8507192 from instance 98a00f1c-3502-4eb3-887b-3c8a3dea2095. Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "cinder-c8b01294-08d0-4fe5-9854-3e394f630cc9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Detach volume completed successfully. Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-c8b01294-08d0-4fe5-9854-3e394f630cc9-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea250db6-155f-471d-86bc-9d077b98e6b0 tempest-VolumesActionsTest-557456838 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:58 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 Sep 17 15:05:58 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[518725b9-773b-4da2-a8b0-20c93f53d1c0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f8d3a6-913e-4237-b29b-d2810860c3f4 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f8d3a6-913e-4237-b29b-d2810860c3f4 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c6f8d3a6-913e-4237-b29b-d2810860c3f4 tempest-VolumesActionsTest-1895420370 None] Volume detach called, but volume not attached. Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6f8d3a6-913e-4237-b29b-d2810860c3f4 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-detach_volume" released by "detach_volume" :: held 0.021s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:59 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 Sep 17 15:05:59 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:59 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9" returned: 0 in 0.735s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:59 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9 Sep 17 15:05:59 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-quobyte-737658e0-bfa6-4fbe-aaf5-92aef8507192" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-quobyte-737658e0-bfa6-4fbe-aaf5-92aef8507192" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:05:59 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9" returned: 0 in 0.686s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91a0e6-fe32-4d6a-8f0c-b493d33afec9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:05:59 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9 Sep 17 15:05:59 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:59 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 Sep 17 15:05:59 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:05:59 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5ba92ada-dd60-497b-aff1-87b1c640edc9" returned: 0 in 0.568s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-quobyte-5ba92ada-dd60-497b-aff1-87b1c640edc9" released by "delete_volume" :: held 1.388s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:05:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Created reservations ['670bb435-0cbf-4531-99fc-66934c603f64', '8b42120b-734f-4197-bafb-b7b56ca4c1ae', '51cacc0f-44d3-416e-8d59-c9373aa97c0c', 'c35c5c7f-5bcd-4947-8f83-798f90562af7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:00 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c8b01294-08d0-4fe5-9854-3e394f630cc9" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-quobyte-c8b01294-08d0-4fe5-9854-3e394f630cc9" released by "delete_volume" :: held 1.291s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:00 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192" returned: 0 in 0.528s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:00 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192 Sep 17 15:06:00 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Created reservations ['6da99c9d-12fc-41f6-98bc-3ed44388733d', 'a567680b-ebd3-4582-b866-c53b4932995d', 'aa367db5-9359-4ed6-b34b-f7474d6013cc', '0876ab70-0bc4-47a7-864d-b2e521f7eb81'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:00 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:00 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:00 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:00 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:00 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-737658e0-bfa6-4fbe-aaf5-92aef8507192" returned: 0 in 0.479s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-quobyte-737658e0-bfa6-4fbe-aaf5-92aef8507192" released by "delete_volume" :: held 1.110s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Created reservations ['ffcac985-e68b-4cf3-a9e8-17d97dd94a6a', 'a1ae0848-45e5-4c17-9cc2-f9453472fb4d', '65bc4d2a-c28d-46a1-9512-58a2a462cbe4', '77de8fa4-a3df-450a-9249-897041693678'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:00 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Deleted volume successfully. Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26a54fd9-beee-4da5-96c6-ff139f981631 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-5ba92ada-dd60-497b-aff1-87b1c640edc9-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:00 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:00 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:01 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.694s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Deleted volume successfully. Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d27653e3-bd4b-40a9-a97f-8432f346b44d tempest-VolumesSnapshotNegativeTestJSON-1352905562 None] Lock "cinder-c8b01294-08d0-4fe5-9854-3e394f630cc9-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:01 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.387s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Deleted volume successfully. Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-66e33e74-beee-4a54-9595-f5034918dd86 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-737658e0-bfa6-4fbe-aaf5-92aef8507192-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Flow 'volume_create_manager' (6d10cef7-aaf6-49dd-a37b-ab95d899c3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a6fe20-99be-47f9-aef1-e63fc0ce782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a6fe20-99be-47f9-aef1-e63fc0ce782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1259121890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e5d627-933d-4b25-8921-7e919d142844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414f79a35e0498695b4d9ee321421b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:02Z,use_quota=True,user_id='d44ed6bd6fcd431390fdcbcac10f65f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baad6dde-3c3e-426b-baca-c8589a68e99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baad6dde-3c3e-426b-baca-c8589a68e99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12012b44-4d1b-4491-a964-6f68fd442a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12012b44-4d1b-4491-a964-6f68fd442a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e5d627-933d-4b25-8921-7e919d142844', 'volume_name': 'volume-82e5d627-933d-4b25-8921-7e919d142844', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee97950-e160-48b5-98d8-8df7cdbaa83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee97950-e160-48b5-98d8-8df7cdbaa83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d51a56-5a28-447e-bfcd-fb1128bf81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Volume 82e5d627-933d-4b25-8921-7e919d142844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e5d627-933d-4b25-8921-7e919d142844', 'volume_size': 1} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1259121890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e5d627-933d-4b25-8921-7e919d142844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6414f79a35e0498695b4d9ee321421b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:02Z,use_quota=True,user_id='d44ed6bd6fcd431390fdcbcac10f65f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Creating volume 82e5d627-933d-4b25-8921-7e919d142844 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:01 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 1073741824 Sep 17 15:06:01 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:02 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 1073741824" returned: 0 in 0.830s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:02 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 Sep 17 15:06:02 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Flow 'volume_create_manager' (a18fbd48-0d33-4477-89c9-52c7536f44be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5a07e6-63fd-4585-a133-565ca6b5d3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d5a07e6-63fd-4585-a133-565ca6b5d3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-221328536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb2f811-ac12-4403-adee-ddcd6847da5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1755e291c0574453bbaf3aac33ea3671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:03Z,use_quota=True,user_id='995d8d1d146a43b2842bd150b61014e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1300843-7c14-4354-af62-eb05bd8382f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1300843-7c14-4354-af62-eb05bd8382f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2f3e5c-f4a9-4b6d-acfa-c9f50aa5b1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c2f3e5c-f4a9-4b6d-acfa-c9f50aa5b1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb2f811-ac12-4403-adee-ddcd6847da5d', 'volume_name': 'volume-afb2f811-ac12-4403-adee-ddcd6847da5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903c5d7-96be-4ee3-a064-0a72b72d3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2903c5d7-96be-4ee3-a064-0a72b72d3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9db994d-5eb7-42c6-ad2a-b04681c28f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Volume afb2f811-ac12-4403-adee-ddcd6847da5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb2f811-ac12-4403-adee-ddcd6847da5d', 'volume_size': 1} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844" returned: 0 in 0.448s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-221328536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb2f811-ac12-4403-adee-ddcd6847da5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1755e291c0574453bbaf3aac33ea3671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:03Z,use_quota=True,user_id='995d8d1d146a43b2842bd150b61014e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Creating volume afb2f811-ac12-4403-adee-ddcd6847da5d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:03 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05d51a56-5a28-447e-bfcd-fb1128bf81ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e5d627-933d-4b25-8921-7e919d142844', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641d529-d0bf-4bbb-8dd2-4f1346f3cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:03 devstack sudo[95120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d 1073741824 Sep 17 15:06:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Volume volume-82e5d627-933d-4b25-8921-7e919d142844 (82e5d627-933d-4b25-8921-7e919d142844): created successfully Sep 17 15:06:03 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c641d529-d0bf-4bbb-8dd2-4f1346f3cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Flow 'volume_create_manager' (6d10cef7-aaf6-49dd-a37b-ab95d899c3b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bdc0701c-5323-442e-bb27-595e2e1beae0 tempest-VolumesTransfersV357Test-78823852 None] Created volume successfully. Sep 17 15:06:03 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d 1073741824" returned: 0 in 0.713s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:03 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d Sep 17 15:06:03 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "cinder-82e5d627-933d-4b25-8921-7e919d142844-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-82e5d627-933d-4b25-8921-7e919d142844-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "cinder-quobyte-82e5d627-933d-4b25-8921-7e919d142844" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-quobyte-82e5d627-933d-4b25-8921-7e919d142844" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[676635ed-057e-43d9-bdae-b08407bb633e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:04 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9db994d-5eb7-42c6-ad2a-b04681c28f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb2f811-ac12-4403-adee-ddcd6847da5d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cdd9fd-154a-4abd-90af-dd7e061ca936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Volume volume-afb2f811-ac12-4403-adee-ddcd6847da5d (afb2f811-ac12-4403-adee-ddcd6847da5d): created successfully Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96cdd9fd-154a-4abd-90af-dd7e061ca936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Flow 'volume_create_manager' (a18fbd48-0d33-4477-89c9-52c7536f44be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2958d870-bb81-46f8-aa17-d4dc12519502 tempest-VolumeQuotasNegativeTestJSON-977649080 None] Created volume successfully. Sep 17 15:06:04 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 Sep 17 15:06:04 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:04 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:04 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844 Sep 17 15:06:04 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:04 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-82e5d627-933d-4b25-8921-7e919d142844" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-quobyte-82e5d627-933d-4b25-8921-7e919d142844" released by "delete_volume" :: held 0.769s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Created reservations ['c691cb84-894c-4459-af0f-68f25dbb2c84', '15f259fa-a70f-49d3-82bb-7c063463ba2d', '8e39e332-80d3-431d-97e5-09cbbac2f001', '90d4bbac-d363-4032-a666-3bb05a833f7a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:05 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:05 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:05 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.613s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Deleted volume successfully. Sep 17 15:06:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbf65c91-1c49-4da3-92ad-3d3eb6af3037 tempest-VolumesTransfersV357Test-120749737 None] Lock "cinder-82e5d627-933d-4b25-8921-7e919d142844-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (69cedd1a-0e3b-4647-85f3-66e88adc4b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9346cda7-d3ab-47b5-bfcb-1a78e53294b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9346cda7-d3ab-47b5-bfcb-1a78e53294b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554374186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722f1f0-a588-4e92-9713-a22d17d380f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:06Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62af41e-acde-428a-87b6-459ce7bb2f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a62af41e-acde-428a-87b6-459ce7bb2f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07290014-64f2-4753-b5fa-e36a4f464baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07290014-64f2-4753-b5fa-e36a4f464baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2722f1f0-a588-4e92-9713-a22d17d380f1', 'volume_name': 'volume-2722f1f0-a588-4e92-9713-a22d17d380f1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4f961-1b8e-4eae-a911-a890ca2f086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfa4f961-1b8e-4eae-a911-a890ca2f086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0543053-28a8-4726-8708-a49a3c36c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Volume 2722f1f0-a588-4e92-9713-a22d17d380f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2722f1f0-a588-4e92-9713-a22d17d380f1', 'volume_size': 1} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-554374186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2722f1f0-a588-4e92-9713-a22d17d380f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:06Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Creating volume 2722f1f0-a588-4e92-9713-a22d17d380f1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:06 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 1073741824 Sep 17 15:06:06 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Acquiring lock "cinder-afb2f811-ac12-4403-adee-ddcd6847da5d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "cinder-afb2f811-ac12-4403-adee-ddcd6847da5d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:06 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 1073741824" returned: 0 in 0.660s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Acquiring lock "cinder-quobyte-afb2f811-ac12-4403-adee-ddcd6847da5d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "cinder-quobyte-afb2f811-ac12-4403-adee-ddcd6847da5d" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[886e7139-fb9f-4634-83a7-3272e234cfb3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:06 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 Sep 17 15:06:06 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:07 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d Sep 17 15:06:07 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:07 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0543053-28a8-4726-8708-a49a3c36c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2722f1f0-a588-4e92-9713-a22d17d380f1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2acfc4-5fdc-44fa-8798-d0ca6af8eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Volume volume-2722f1f0-a588-4e92-9713-a22d17d380f1 (2722f1f0-a588-4e92-9713-a22d17d380f1): created successfully Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d2acfc4-5fdc-44fa-8798-d0ca6af8eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (69cedd1a-0e3b-4647-85f3-66e88adc4b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b56fa8d6-c5c8-4b19-b907-0261cc74a968 tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:06:07 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d" returned: 0 in 0.622s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:07 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d Sep 17 15:06:07 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:07 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb2f811-ac12-4403-adee-ddcd6847da5d" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "cinder-quobyte-afb2f811-ac12-4403-adee-ddcd6847da5d" released by "delete_volume" :: held 0.991s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Created reservations ['02571495-c544-442e-987f-e975880802e2', '619f5fe3-be15-481d-8d03-50afce8b0b51', '1dd8be3a-f53e-4418-b299-63f7c436253b', '0eae498c-016a-4660-aedf-819e0eabed91'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:08 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:08 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:08 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Deleted volume successfully. Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac6ea051-208d-4d55-8ee1-0a290db53afb tempest-VolumeQuotasNegativeTestJSON-977649080 None] Lock "cinder-afb2f811-ac12-4403-adee-ddcd6847da5d-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-2722f1f0-a588-4e92-9713-a22d17d380f1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "cinder-2722f1f0-a588-4e92-9713-a22d17d380f1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-quobyte-2722f1f0-a588-4e92-9713-a22d17d380f1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-2722f1f0-a588-4e92-9713-a22d17d380f1" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[023fd7be-0fe6-4729-b025-f83677949db2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:08 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 Sep 17 15:06:08 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:09 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1" returned: 0 in 0.478s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:09 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1 Sep 17 15:06:09 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:09 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2722f1f0-a588-4e92-9713-a22d17d380f1" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-2722f1f0-a588-4e92-9713-a22d17d380f1" released by "delete_volume" :: held 0.885s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Created reservations ['3c49dc63-3301-4772-a080-2752e1eba382', '216c0888-f2be-4766-8f3b-a0f1c52cfd28', '84115f5e-8077-4cd5-9c3d-5cfe9b114980', 'f5ae706b-c471-4a4f-a4bd-a6fa68eb58af'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:09 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:09 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:09 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Deleted volume successfully. Sep 17 15:06:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-04978d31-ffd7-432f-953e-44146b0f4992 tempest-VolumesActionsTest-557456838 None] Lock "cinder-2722f1f0-a588-4e92-9713-a22d17d380f1-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (b9a1a66c-f00c-4d3d-a50f-b790c72605ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9a1b9d-a29b-427d-8431-bb550eaccbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9a1b9d-a29b-427d-8431-bb550eaccbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376868724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:10Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6fbb92-c6cb-452a-a90b-a97372dea063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c6fbb92-c6cb-452a-a90b-a97372dea063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab0ebf-81e6-4fd9-b84a-ea040be9ed8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab0ebf-81e6-4fd9-b84a-ea040be9ed8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37', 'volume_name': 'volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd696c47-dd2c-491b-8129-86c84453efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd696c47-dd2c-491b-8129-86c84453efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89f4c41-3b90-42ed-9fe8-46857ded4df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Volume 2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37', 'volume_size': 1} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-376868724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:10Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Creating volume 2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:10 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:10 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 1073741824 Sep 17 15:06:10 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:11 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 1073741824" returned: 0 in 0.549s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:11 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 Sep 17 15:06:11 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:11 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e89f4c41-3b90-42ed-9fe8-46857ded4df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ecf7ac-e911-4491-aeaa-2691459a4229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Volume volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 (2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37): created successfully Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ecf7ac-e911-4491-aeaa-2691459a4229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (b9a1a66c-f00c-4d3d-a50f-b790c72605ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ba7ff65c-4a5a-4ab4-b998-0a1330512e21 tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "cinder-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-quobyte-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d229a6b6-2fe8-4c23-a651-6683dafdf6dd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:13 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 Sep 17 15:06:13 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:13 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" returned: 0 in 0.557s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:13 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37 Sep 17 15:06:13 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:13 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" returned: 0 in 0.399s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37" released by "delete_volume" :: held 1.042s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Created reservations ['9417c310-b333-4606-89ef-66e379ef3bce', 'abd29bef-4145-43cb-95b1-03aeff25691d', 'e19c6958-129f-4f74-9713-4ece315c3fab', '0531c45f-be68-435e-9ecf-3a0b3168b975'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:14 devstack sudo[95196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:14 devstack sudo[95196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:14 devstack sudo[95196]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Deleted volume successfully. Sep 17 15:06:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-030d73c8-3432-4f63-96f6-4f1b31ae6c25 tempest-VolumesActionsTest-557456838 None] Lock "cinder-2cfc295d-d4a1-48b1-a3c3-99e5e7b2ff37-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (dcbc9a04-16f8-4a09-8b6f-f5551ec17f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffba41-3b6f-494f-8734-23a3cd80696b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ffba41-3b6f-494f-8734-23a3cd80696b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199772044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8b32fd-fc04-441e-9bf1-a4e9eba82df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:16Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06811a2-706f-4c3e-a854-985dc6750dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a06811a2-706f-4c3e-a854-985dc6750dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f2c53c-1297-4fb3-8563-eb2bc9cb259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f2c53c-1297-4fb3-8563-eb2bc9cb259c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8b32fd-fc04-441e-9bf1-a4e9eba82df1', 'volume_name': 'volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7eb4e2-18a1-499f-b2f5-b0020e3d8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7eb4e2-18a1-499f-b2f5-b0020e3d8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa27d67-ab86-433a-8556-c9f64524e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Volume df8b32fd-fc04-441e-9bf1-a4e9eba82df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1', 'volume_size': 1} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1199772044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8b32fd-fc04-441e-9bf1-a4e9eba82df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:16Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Creating volume df8b32fd-fc04-441e-9bf1-a4e9eba82df1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:15 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:15 devstack sudo[95199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 1073741824 Sep 17 15:06:15 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:16 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 1073741824" returned: 0 in 0.596s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:16 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 Sep 17 15:06:16 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:16 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa27d67-ab86-433a-8556-c9f64524e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fc2f6e-f9aa-49a0-8097-5453756e2d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Volume volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 (df8b32fd-fc04-441e-9bf1-a4e9eba82df1): created successfully Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59fc2f6e-f9aa-49a0-8097-5453756e2d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (dcbc9a04-16f8-4a09-8b6f-f5551ec17f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0d0a4578-1ce6-4f24-a212-9aa1bfaa3e05 tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-df8b32fd-fc04-441e-9bf1-a4e9eba82df1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "cinder-df8b32fd-fc04-441e-9bf1-a4e9eba82df1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-quobyte-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8498a3-b95b-4d69-b8e7-623a0811aaa4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:18 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 Sep 17 15:06:18 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:18 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" returned: 0 in 0.560s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:18 devstack sudo[95213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1 Sep 17 15:06:18 devstack sudo[95213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:19 devstack sudo[95213]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-df8b32fd-fc04-441e-9bf1-a4e9eba82df1" released by "delete_volume" :: held 1.008s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Created reservations ['903c35e8-2bad-415b-9c8a-af7e4856443f', '076035ea-4852-47e3-9810-b779eac5d9df', '9f4c4914-d4cd-4c4e-bb3a-2951292a93e3', '21f67f80-c1b8-42ae-8c5c-724ae6fa3864'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:19 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:19 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:19 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Deleted volume successfully. Sep 17 15:06:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4bc46350-c6f9-4413-8700-71bbb4220b18 tempest-VolumesActionsTest-557456838 None] Lock "cinder-df8b32fd-fc04-441e-9bf1-a4e9eba82df1-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (d3d7c095-7084-41d4-90ce-2d89db33477a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a7112-f51f-428d-99c8-8b5dcc43e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0a7112-f51f-428d-99c8-8b5dcc43e011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-733826731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1882829d-5139-48d0-9817-f04696a32950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:21Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c29020-960d-4b90-9edf-f96bb22d36b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c29020-960d-4b90-9edf-f96bb22d36b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a287cef-802d-4b1f-a4aa-090bd54fd56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a287cef-802d-4b1f-a4aa-090bd54fd56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1882829d-5139-48d0-9817-f04696a32950', 'volume_name': 'volume-1882829d-5139-48d0-9817-f04696a32950', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf74640-cbaf-4185-b7a5-614cd4d19911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdf74640-cbaf-4185-b7a5-614cd4d19911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eefbb39-2c8d-47bf-8b48-ab82750a8b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Volume 1882829d-5139-48d0-9817-f04696a32950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1882829d-5139-48d0-9817-f04696a32950', 'volume_size': 1} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-733826731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1882829d-5139-48d0-9817-f04696a32950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:21Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Creating volume 1882829d-5139-48d0-9817-f04696a32950 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:21 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 1073741824 Sep 17 15:06:21 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:22 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 1073741824" returned: 0 in 0.748s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:22 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 Sep 17 15:06:22 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:22 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eefbb39-2c8d-47bf-8b48-ab82750a8b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1882829d-5139-48d0-9817-f04696a32950', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d372761-7f5e-4243-ab76-0dbd908da2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Volume volume-1882829d-5139-48d0-9817-f04696a32950 (1882829d-5139-48d0-9817-f04696a32950): created successfully Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d372761-7f5e-4243-ab76-0dbd908da2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (d3d7c095-7084-41d4-90ce-2d89db33477a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7c9306a5-14e6-41ed-b133-5ada60b85434 tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-1882829d-5139-48d0-9817-f04696a32950-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "cinder-1882829d-5139-48d0-9817-f04696a32950-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Acquiring lock "cinder-quobyte-1882829d-5139-48d0-9817-f04696a32950" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-1882829d-5139-48d0-9817-f04696a32950" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7bf399-b103-4a7d-b95f-8cab931544f8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:23 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 Sep 17 15:06:23 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950 Sep 17 15:06:24 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:24 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1882829d-5139-48d0-9817-f04696a32950" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "cinder-quobyte-1882829d-5139-48d0-9817-f04696a32950" released by "delete_volume" :: held 0.821s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Created reservations ['74e67bf3-8322-4946-8bbb-297deed58ec9', '53d26acc-74d5-4a6c-8f76-42a8379c3bd5', 'cd185e6c-2438-406f-9a72-0d18a8ff6b03', '56f641c8-a9d7-4ec1-a384-e673229011ed'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:24 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:24 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:25 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Deleted volume successfully. Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dc2787ff-a7a9-4d19-901b-e10e303068b7 tempest-VolumesActionsTest-557456838 None] Lock "cinder-1882829d-5139-48d0-9817-f04696a32950-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (9291dc45-6723-43cd-8bc6-37507fa7e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b03e1e8-2c1b-44bc-ae6a-12d6e649c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b03e1e8-2c1b-44bc-ae6a-12d6e649c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973572904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ba7026-d44c-4b19-96ec-eb54cc8bf64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:26Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795359ed-6f3d-4785-8185-0c37b34c01de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795359ed-6f3d-4785-8185-0c37b34c01de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade4a059-64ac-490e-a979-d5ede30ff766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade4a059-64ac-490e-a979-d5ede30ff766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59ba7026-d44c-4b19-96ec-eb54cc8bf64c', 'volume_name': 'volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849c3988-5851-4560-be6a-6a48ece47e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (849c3988-5851-4560-be6a-6a48ece47e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16e893e-49da-4c0d-8c1d-c638c00dba06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Volume 59ba7026-d44c-4b19-96ec-eb54cc8bf64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c', 'volume_size': 1} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973572904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59ba7026-d44c-4b19-96ec-eb54cc8bf64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6f967967cc4db7a6b51d328af193b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:26Z,use_quota=True,user_id='fb59e3789ada4ccdb8f19cb7ae993885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Creating volume 59ba7026-d44c-4b19-96ec-eb54cc8bf64c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:25 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c 1073741824 Sep 17 15:06:25 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:26 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c 1073741824" returned: 0 in 0.674s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:26 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c Sep 17 15:06:26 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:26 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16e893e-49da-4c0d-8c1d-c638c00dba06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5184e0b-944b-4bac-9ed6-298f86b25d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Volume volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c (59ba7026-d44c-4b19-96ec-eb54cc8bf64c): created successfully Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5184e0b-944b-4bac-9ed6-298f86b25d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Flow 'volume_create_manager' (9291dc45-6723-43cd-8bc6-37507fa7e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8f73a86b-cc4d-4394-84c9-f89f4c07273d tempest-VolumesActionsTest-1895420370 None] Created volume successfully. Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-59ba7026-d44c-4b19-96ec-eb54cc8bf64c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-59ba7026-d44c-4b19-96ec-eb54cc8bf64c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "cinder-quobyte-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-quobyte-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4eda5-2e03-41bd-b3c6-9ddd21b36805]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:28 devstack sudo[95250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c Sep 17 15:06:28 devstack sudo[95250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:29 devstack sudo[95250]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:29 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c Sep 17 15:06:29 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:29 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-quobyte-59ba7026-d44c-4b19-96ec-eb54cc8bf64c" released by "delete_volume" :: held 0.727s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Created reservations ['b902bce2-4ce9-4e51-8daa-ec695fe90691', 'd6b59fcb-4e13-454c-bafe-911b9292389f', '3f78b4d0-3998-4a66-8250-0a3ac154791b', '354981ec-40e9-4bf8-bc42-409496991fff'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:29 devstack sudo[95258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:29 devstack sudo[95258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:29 devstack sudo[95258]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Deleted volume successfully. Sep 17 15:06:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8a12af00-7df2-4a21-a243-445a6ac30e82 tempest-VolumesActionsTest-1895420370 None] Lock "cinder-59ba7026-d44c-4b19-96ec-eb54cc8bf64c-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=146,cinder:INSERT=42,cinder:UPDATE=187,cinder:DELETE=13 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=140,cinder:INSERT=56,cinder:UPDATE=197,cinder:DELETE=18 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Flow 'volume_create_manager' (b8b64b28-0c7a-4e08-8dff-ed876f735769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d1c0ec-d141-4be2-aada-b6fae21c5708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d1c0ec-d141-4be2-aada-b6fae21c5708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19175253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74031b-a7c7-45b4-a2be-0f4fead5cc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81269fdd82624ee181d7d728b4448bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:33Z,use_quota=True,user_id='958d6ee0c6614eb399e34c7151c1f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54aa9d34-ee75-4c62-a3e4-c9491091a1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54aa9d34-ee75-4c62-a3e4-c9491091a1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc63207-ef6e-41ba-aa69-bbe98802dff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc63207-ef6e-41ba-aa69-bbe98802dff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf74031b-a7c7-45b4-a2be-0f4fead5cc6b', 'volume_name': 'volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7ee96a-4e6f-411f-80cf-b04257fd5dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7ee96a-4e6f-411f-80cf-b04257fd5dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574209c-78a5-4fa3-8939-32e34076482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:32 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b', 'volume_size': 1} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19175253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf74031b-a7c7-45b4-a2be-0f4fead5cc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81269fdd82624ee181d7d728b4448bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:33Z,use_quota=True,user_id='958d6ee0c6614eb399e34c7151c1f977',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Creating volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:32 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:33 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b 1073741824 Sep 17 15:06:33 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:33 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b 1073741824" returned: 0 in 0.592s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:33 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:06:33 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:33 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b574209c-78a5-4fa3-8939-32e34076482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6d6a21-edec-40db-a08f-658c1047fab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Volume volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b (bf74031b-a7c7-45b4-a2be-0f4fead5cc6b): created successfully Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d6d6a21-edec-40db-a08f-658c1047fab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Flow 'volume_create_manager' (b8b64b28-0c7a-4e08-8dff-ed876f735769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-18003689-ac5b-4150-8ee3-6e8d415c228e tempest-VolumesActionsTest-1093372887 None] Created volume successfully. Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Flow 'volume_create_manager' (e7119eb7-9c95-40bf-8242-853ab29cad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79043df-9270-4271-bcc6-d14a064d7043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c79043df-9270-4271-bcc6-d14a064d7043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-437874483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9646f383-7448-4025-9fe4-6c90c71f1e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c804c0331fb4d07aa325d5ea4f85c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:38Z,use_quota=True,user_id='74978caa70144160966645445f22cc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a50ffb-503c-4228-b983-478337860e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23a50ffb-503c-4228-b983-478337860e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074d3a0f-dc22-4d2f-aef7-1b057979ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (074d3a0f-dc22-4d2f-aef7-1b057979ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9646f383-7448-4025-9fe4-6c90c71f1e44', 'volume_name': 'volume-9646f383-7448-4025-9fe4-6c90c71f1e44', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc932e80-46d1-41a1-804a-8369b63a0636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc932e80-46d1-41a1-804a-8369b63a0636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3fdd6d-6905-4af0-a925-85a0fb92824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Volume 9646f383-7448-4025-9fe4-6c90c71f1e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9646f383-7448-4025-9fe4-6c90c71f1e44', 'volume_size': 1} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-437874483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9646f383-7448-4025-9fe4-6c90c71f1e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c804c0331fb4d07aa325d5ea4f85c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:38Z,use_quota=True,user_id='74978caa70144160966645445f22cc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Creating volume 9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:37 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 1073741824 Sep 17 15:06:37 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:38 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 1073741824" returned: 0 in 0.852s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:38 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:06:38 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:39 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.591s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3fdd6d-6905-4af0-a925-85a0fb92824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9646f383-7448-4025-9fe4-6c90c71f1e44', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5d5dbb-1b40-4aec-b8f5-9fb70b69f39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Volume volume-9646f383-7448-4025-9fe4-6c90c71f1e44 (9646f383-7448-4025-9fe4-6c90c71f1e44): created successfully Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5d5dbb-1b40-4aec-b8f5-9fb70b69f39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Flow 'volume_create_manager' (e7119eb7-9c95-40bf-8242-853ab29cad46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-986752ba-72d6-4a07-a281-f46e4f04c206 tempest-TestStampPattern-1047644296 None] Created volume successfully. Sep 17 15:06:49 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:49 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72b1a6d8-9359-4137-9abf-75988ea0ac3a tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72b1a6d8-9359-4137-9abf-75988ea0ac3a tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" acquired by "attach_volume" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-72b1a6d8-9359-4137-9abf-75988ea0ac3a tempest-VolumesActionsTest-1093372887 None] Attaching volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b to instance 1a0fcf22-238d-42b2-ad86-090de2472c61 at mountpoint /dev/vdb on host None. Sep 17 15:06:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-72b1a6d8-9359-4137-9abf-75988ea0ac3a tempest-VolumesActionsTest-1093372887 None] Attach volume completed successfully. Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72b1a6d8-9359-4137-9abf-75988ea0ac3a tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" released by "attach_volume" :: held 0.197s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-65b83a6a-66bb-4e64-a253-681e02653f42 tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-65b83a6a-66bb-4e64-a253-681e02653f42 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:06:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-65b83a6a-66bb-4e64-a253-681e02653f42 tempest-VolumesActionsTest-1093372887 None] Detaching volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b from instance 1a0fcf22-238d-42b2-ad86-090de2472c61. Sep 17 15:06:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-65b83a6a-66bb-4e64-a253-681e02653f42 tempest-VolumesActionsTest-1093372887 None] Detach volume completed successfully. Sep 17 15:06:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-65b83a6a-66bb-4e64-a253-681e02653f42 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (cdb78e72-0f92-48b5-9110-a497dea0ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8903169-3674-484a-8de0-9fde286cb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8903169-3674-484a-8de0-9fde286cb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1730188353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99b872e-a881-4fe2-ab1b-79f2b8650c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:55Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c053d0-4959-48d0-baae-b814e001b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c053d0-4959-48d0-baae-b814e001b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caeed760-d413-4fd8-9ddb-01b541a3b2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caeed760-d413-4fd8-9ddb-01b541a3b2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a99b872e-a881-4fe2-ab1b-79f2b8650c9b', 'volume_name': 'volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d763181-25a5-4827-9280-691d2d2da6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d763181-25a5-4827-9280-691d2d2da6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2eb234-6ef1-4f42-875c-cf558ffc3cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Volume a99b872e-a881-4fe2-ab1b-79f2b8650c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b', 'volume_size': 1} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1730188353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a99b872e-a881-4fe2-ab1b-79f2b8650c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:55Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Creating volume a99b872e-a881-4fe2-ab1b-79f2b8650c9b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:54 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b 1073741824 Sep 17 15:06:54 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Flow 'volume_create_manager' (4da32dec-d078-4219-92e2-15563daa2f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7ff751-7498-4643-b7fd-0f9cf5ca8b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7ff751-7498-4643-b7fd-0f9cf5ca8b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-570170288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af62301b-eef4-4351-ac4e-e455eacd613f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eceb9d737812434d9a960191a7846a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:55Z,use_quota=True,user_id='a5a7906b47e94333aa9af1d0a75d8b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14c9fd2-565e-4c13-b02a-1c1eb2710176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e14c9fd2-565e-4c13-b02a-1c1eb2710176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d742f67-87ce-42a7-840b-373730b047d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:06:55 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b 1073741824" returned: 0 in 0.956s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:55 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b Sep 17 15:06:55 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d742f67-87ce-42a7-840b-373730b047d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af62301b-eef4-4351-ac4e-e455eacd613f', 'volume_name': 'volume-af62301b-eef4-4351-ac4e-e455eacd613f', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33f9fc-60de-45fa-af3a-684fef2f4e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb33f9fc-60de-45fa-af3a-684fef2f4e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d00956-ac3d-4137-b040-689db699d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Volume af62301b-eef4-4351-ac4e-e455eacd613f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af62301b-eef4-4351-ac4e-e455eacd613f', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:06:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Trying to clone af62301b-eef4-4351-ac4e-e455eacd613f from image 8d02878c-b12d-4421-bc53-544f1bf812dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:06:56 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" returned: 0 in 0.413s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2eb234-6ef1-4f42-875c-cf558ffc3cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c01933-c192-4210-8fd3-76decc6a0329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Volume volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b (a99b872e-a881-4fe2-ab1b-79f2b8650c9b): created successfully Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c01933-c192-4210-8fd3-76decc6a0329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (cdb78e72-0f92-48b5-9110-a497dea0ed06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-73ac8f79-12c6-4fab-87d7-8ecd346726ad tempest-VolumesListAdminTestJSON-52301846 None] Created volume successfully. Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:06:56 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8818c2d4-510c-48ec-9200-c8acbed7c2f2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:57 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:06:57 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:57 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD Sep 17 15:06:57 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:57 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd is fetched for user a5a7906b47e94333aa9af1d0a75d8b45. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:06:57 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.587s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fc1abd-21e9-4c4a-b47d-4bc17941d701]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:06:57 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD Sep 17 15:06:57 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:57 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-570170288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af62301b-eef4-4351-ac4e-e455eacd613f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eceb9d737812434d9a960191a7846a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:55Z,use_quota=True,user_id='a5a7906b47e94333aa9af1d0a75d8b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Creating volume af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:57 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1073741824 Sep 17 15:06:58 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (28e1c2f1-0f1d-40b4-b7c9-f803d314ffcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe9b3dd-b151-4a1c-bb36-6582ed5f09c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe9b3dd-b151-4a1c-bb36-6582ed5f09c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-594670105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000a6fcc-ade7-48c4-904b-66f39f1cbde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:58Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb369d4-8531-4e5e-a17e-6368da7e4d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbb369d4-8531-4e5e-a17e-6368da7e4d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f272e4-682b-4b2b-9d1e-86dc5b21145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20f272e4-682b-4b2b-9d1e-86dc5b21145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '000a6fcc-ade7-48c4-904b-66f39f1cbde5', 'volume_name': 'volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eb32b9-9199-42ee-b11d-ac3bcc68b217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88eb32b9-9199-42ee-b11d-ac3bcc68b217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfd071c-acd2-4b86-9807-88fe0c0e5d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:06:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Volume 000a6fcc-ade7-48c4-904b-66f39f1cbde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5', 'volume_size': 1} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:58 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1073741824" returned: 0 in 0.579s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:58 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f Sep 17 15:06:58 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:58 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.795s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-594670105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=000a6fcc-ade7-48c4-904b-66f39f1cbde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:06:58Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Creating volume 000a6fcc-ade7-48c4-904b-66f39f1cbde5 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:06:58 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:06:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:59 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 1073741824 Sep 17 15:06:59 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Attempting download of 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume af62301b-eef4-4351-ac4e-e455eacd613f. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[11685713-c110-480e-8b8c-a1afe85d8b51]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:59 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t Sep 17 15:06:59 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:59 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t" returned: 0 in 0.543s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:59 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 1073741824" returned: 0 in 0.770s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:06:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:06:59 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 Sep 17 15:06:59 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:06:59 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t Sep 17 15:06:59 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:00 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfd071c-acd2-4b86-9807-88fe0c0e5d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17af44ed-33a4-42c7-83aa-d3b7796646f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Volume volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 (000a6fcc-ade7-48c4-904b-66f39f1cbde5): created successfully Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17af44ed-33a4-42c7-83aa-d3b7796646f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (28e1c2f1-0f1d-40b4-b7c9-f803d314ffcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5f086c8a-6844-43c2-a4bf-e399ce457876 tempest-VolumesListAdminTestJSON-52301846 None] Created volume successfully. Sep 17 15:07:00 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t" returned: 1 in 0.659s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_1onxb7_t' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e2b71a-9620-4f40-a455-7b3926d75700]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:00 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD Sep 17 15:07:00 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:00 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:00 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] 8d02878c-b12d-4421-bc53-544f1bf812dd was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:07:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:01 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f Sep 17 15:07:01 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (0e84556c-e690-4d3c-8d21-3333e68b8b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cb367-26dd-4aa1-b974-12465bcdcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6cb367-26dd-4aa1-b974-12465bcdcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-337312908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f4e9b-90b7-4f3c-a53c-b9de587447e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:02Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9cce1b-a9c9-4513-bfbe-1bb469fe26a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9cce1b-a9c9-4513-bfbe-1bb469fe26a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c6dcd4-967f-44d6-b148-5e5c3287537f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c6dcd4-967f-44d6-b148-5e5c3287537f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4f4e9b-90b7-4f3c-a53c-b9de587447e0', 'volume_name': 'volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bcaf3f-fb64-4eb1-a54c-76056a158df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1bcaf3f-fb64-4eb1-a54c-76056a158df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae42caac-d378-4b9c-988e-739f4538cb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Volume 3d4f4e9b-90b7-4f3c-a53c-b9de587447e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0', 'volume_size': 1} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-337312908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4f4e9b-90b7-4f3c-a53c-b9de587447e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='900c7a5383f9472a8ebfda26d43bf5ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:02Z,use_quota=True,user_id='b7a9ef6f1dff49c881473360528d6d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Creating volume 3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:02 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 1073741824 Sep 17 15:07:02 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:02 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 1073741824" returned: 0 in 0.678s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:03 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 Sep 17 15:07:03 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:03 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae42caac-d378-4b9c-988e-739f4538cb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2673b871-63a9-47e4-9576-255a653a67f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Volume volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 (3d4f4e9b-90b7-4f3c-a53c-b9de587447e0): created successfully Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2673b871-63a9-47e4-9576-255a653a67f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Flow 'volume_create_manager' (0e84556c-e690-4d3c-8d21-3333e68b8b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f8bf61b0-dca9-4e5b-a54c-00a376005640 tempest-VolumesListAdminTestJSON-52301846 None] Created volume successfully. Sep 17 15:07:03 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f" returned: 0 in 2.900s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_khfd5gkrdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:07:03 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Converted 112.00 MB image at 38.60 MB/s Sep 17 15:07:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:03 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1G Sep 17 15:07:03 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:04 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f 1G" returned: 0 in 0.566s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Downloaded image 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume af62301b-eef4-4351-ac4e-e455eacd613f successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd for user a5a7906b47e94333aa9af1d0a75d8b45 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Marking volume af62301b-eef4-4351-ac4e-e455eacd613f as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Copying metadata from image 8d02878c-b12d-4421-bc53-544f1bf812dd to af62301b-eef4-4351-ac4e-e455eacd613f. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Creating volume glance metadata for volume af62301b-eef4-4351-ac4e-e455eacd613f backed by image 8d02878c-b12d-4421-bc53-544f1bf812dd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d00956-ac3d-4137-b040-689db699d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af62301b-eef4-4351-ac4e-e455eacd613f', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2233b23-c6bb-4b6f-96e9-4310c3c0b79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Volume volume-af62301b-eef4-4351-ac4e-e455eacd613f (af62301b-eef4-4351-ac4e-e455eacd613f): created successfully Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2233b23-c6bb-4b6f-96e9-4310c3c0b79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Flow 'volume_create_manager' (4da32dec-d078-4219-92e2-15563daa2f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2cd25438-4530-4bc6-9572-516876085023 tempest-VolumesImageMetadata-1167763563 None] Created volume successfully. Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Flow 'volume_create_manager' (ed4a6a45-7294-42e6-9b30-b57f88629ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47b055-8065-48e1-8e64-6a07d5a2ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47b055-8065-48e1-8e64-6a07d5a2ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb5ed45-b84d-453b-a3c4-66d2217ce49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998a8d05416b4f0987f176e076ae08fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:06Z,use_quota=True,user_id='1dd7ca84e9a5433988ef3c9e706acb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07ed862-1c86-49ea-b936-b49be3cfa193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07ed862-1c86-49ea-b936-b49be3cfa193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa1a2ca-7c3f-4245-910f-ed7a5a804265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa1a2ca-7c3f-4245-910f-ed7a5a804265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afb5ed45-b84d-453b-a3c4-66d2217ce49e', 'volume_name': 'volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8266ff-718d-4db8-8c8a-2d38f266e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8266ff-718d-4db8-8c8a-2d38f266e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad22eed6-971c-44af-84c3-cba28b1198d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Volume afb5ed45-b84d-453b-a3c4-66d2217ce49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e', 'volume_size': 1} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afb5ed45-b84d-453b-a3c4-66d2217ce49e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='998a8d05416b4f0987f176e076ae08fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:06Z,use_quota=True,user_id='1dd7ca84e9a5433988ef3c9e706acb69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Creating volume afb5ed45-b84d-453b-a3c4-66d2217ce49e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:07:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:05 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e 1073741824 Sep 17 15:07:05 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Acquiring lock "cinder-af62301b-eef4-4351-ac4e-e455eacd613f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "cinder-af62301b-eef4-4351-ac4e-e455eacd613f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Acquiring lock "cinder-quobyte-af62301b-eef4-4351-ac4e-e455eacd613f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "cinder-quobyte-af62301b-eef4-4351-ac4e-e455eacd613f" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb4d31-df4b-473d-b181-4e0819f5f227]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:06 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e 1073741824" returned: 0 in 0.715s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:06 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f Sep 17 15:07:06 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:06 devstack sudo[95718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e Sep 17 15:07:06 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:06 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad22eed6-971c-44af-84c3-cba28b1198d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f390e1-eb02-421d-904f-c42cbb19929d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Volume volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e (afb5ed45-b84d-453b-a3c4-66d2217ce49e): created successfully Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f390e1-eb02-421d-904f-c42cbb19929d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Flow 'volume_create_manager' (ed4a6a45-7294-42e6-9b30-b57f88629ab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d5a7bc47-7f4e-4325-9711-ab5704dc6d5a tempest-VolumesListAdminTestJSON-363887130 None] Created volume successfully. Sep 17 15:07:07 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f" returned: 0 in 0.635s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:07 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f Sep 17 15:07:07 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:07 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-af62301b-eef4-4351-ac4e-e455eacd613f" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "cinder-quobyte-af62301b-eef4-4351-ac4e-e455eacd613f" released by "delete_volume" :: held 0.950s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Created reservations ['ef2a28b7-4f20-40fa-81c0-8421db4e0627', '68374cfb-1168-4cc6-bbfb-9bb907888ba1', '6070130a-eeab-47d7-9e47-31f10255789c', '920ee50e-f9c7-4fca-8ba9-ed8441bad2db'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:07 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:07 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Acquiring lock "cinder-afb5ed45-b84d-453b-a3c4-66d2217ce49e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "cinder-afb5ed45-b84d-453b-a3c4-66d2217ce49e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Acquiring lock "cinder-quobyte-afb5ed45-b84d-453b-a3c4-66d2217ce49e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:07 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "cinder-quobyte-afb5ed45-b84d-453b-a3c4-66d2217ce49e" acquired by "delete_volume" :: waited 0.060s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Deleted volume successfully. Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5899331d-6a4e-4eb8-b33e-cb8bee858575]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-29495f30-0030-48ad-8143-728b0c8f8915 tempest-VolumesImageMetadata-1167763563 None] Lock "cinder-af62301b-eef4-4351-ac4e-e455eacd613f-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-quobyte-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0cf608-be7f-4c31-b638-8085e4ec098c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:08 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e Sep 17 15:07:08 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9ecd8e6-59d4-4333-9d76-7bb2a2d36c79 tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" by "attach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:08 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9ecd8e6-59d4-4333-9d76-7bb2a2d36c79 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" acquired by "attach_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:08 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9ecd8e6-59d4-4333-9d76-7bb2a2d36c79 tempest-VolumesActionsTest-1093372887 None] Attaching volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b to instance c1625d00-818c-41d3-94a8-e20af02a1116 at mountpoint /dev/vdb on host None. Sep 17 15:07:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9ecd8e6-59d4-4333-9d76-7bb2a2d36c79 tempest-VolumesActionsTest-1093372887 None] Attach volume completed successfully. Sep 17 15:07:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9ecd8e6-59d4-4333-9d76-7bb2a2d36c79 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" released by "attach_volume" :: held 0.221s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:09 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e" returned: 0 in 0.963s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:09 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e Sep 17 15:07:09 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:09 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" returned: 0 in 0.875s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:09 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0 Sep 17 15:07:09 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:09 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" returned: 0 in 0.449s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:09 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-afb5ed45-b84d-453b-a3c4-66d2217ce49e" returned: 0 in 0.619s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0" released by "delete_volume" :: held 1.444s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "cinder-quobyte-afb5ed45-b84d-453b-a3c4-66d2217ce49e" released by "delete_volume" :: held 1.728s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c2816040-9233-4c92-8e84-c5b10b7f4dc8 tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" by "detach_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c2816040-9233-4c92-8e84-c5b10b7f4dc8 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c2816040-9233-4c92-8e84-c5b10b7f4dc8 tempest-VolumesActionsTest-1093372887 None] Detaching volume bf74031b-a7c7-45b4-a2be-0f4fead5cc6b from instance c1625d00-818c-41d3-94a8-e20af02a1116. Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Created reservations ['1564877e-33b2-4310-8b43-012cd88ff378', '53521e97-65ff-4974-bacb-0b3723271550', '75de36bc-08e5-4aab-bc5c-3b8fb599833f', '92c7848b-f1bd-4020-9412-2a714826ff06'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Created reservations ['da964819-e45a-4cd4-a4b1-d48f68c4b67c', '5b26fed4-7de1-451a-8582-510126f65227', '4da57105-89eb-4cf8-b9e7-e6c32641c8a8', '3709adf0-9e68-4b39-b6bf-65e179c009a2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c2816040-9233-4c92-8e84-c5b10b7f4dc8 tempest-VolumesActionsTest-1093372887 None] Detach volume completed successfully. Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c2816040-9233-4c92-8e84-c5b10b7f4dc8 tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-detach_volume" released by "detach_volume" :: held 0.184s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:10 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:10 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:10 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:10 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:10 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.545s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Deleted volume successfully. Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9df2c5d1-8c68-4406-8412-146cd1973f18 tempest-VolumesListAdminTestJSON-363887130 None] Lock "cinder-afb5ed45-b84d-453b-a3c4-66d2217ce49e-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:10 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-000a6fcc-ade7-48c4-904b-66f39f1cbde5-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.546s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Deleted volume successfully. Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-000a6fcc-ade7-48c4-904b-66f39f1cbde5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-30496529-2c8f-468f-be27-de5cea2612a9 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-3d4f4e9b-90b7-4f3c-a53c-b9de587447e0-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-quobyte-000a6fcc-ade7-48c4-904b-66f39f1cbde5" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-000a6fcc-ade7-48c4-904b-66f39f1cbde5" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[978554ab-2198-465e-9ee7-01db46dcb010]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 Sep 17 15:07:11 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:11 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5 Sep 17 15:07:11 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:11 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-000a6fcc-ade7-48c4-904b-66f39f1cbde5" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-000a6fcc-ade7-48c4-904b-66f39f1cbde5" released by "delete_volume" :: held 1.139s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Created reservations ['32bc8369-ae31-47f5-b06b-02b646f7a0bd', 'f2abe491-b7ae-4c95-9b38-394974a40045', '74f4c6bf-d21c-4412-80ad-f85e44f95fd8', 'bc894ae9-04d6-4748-b59b-831d7c5257f7'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:12 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:12 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:12 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Deleted volume successfully. Sep 17 15:07:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2db3d1c9-329e-4732-85f6-78c99c928b96 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-000a6fcc-ade7-48c4-904b-66f39f1cbde5-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-a99b872e-a881-4fe2-ab1b-79f2b8650c9b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-a99b872e-a881-4fe2-ab1b-79f2b8650c9b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "cinder-quobyte-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9594fef8-d97d-4b26-b4c3-bf9198e4ecc9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:13 devstack sudo[95809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b Sep 17 15:07:13 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:13 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:13 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b Sep 17 15:07:13 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:14 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-quobyte-a99b872e-a881-4fe2-ab1b-79f2b8650c9b" released by "delete_volume" :: held 0.982s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Flow 'volume_create_manager' (cb565fbf-35b6-41ba-822c-5aa7aab2764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a194abb1-1cc1-428e-86a4-3ba7476d64cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Created reservations ['e9119ddf-f17a-44a9-a733-29217840ca82', 'b50b0f30-4b19-4ca6-ba24-f9e19b9aa223', 'f347692e-39f5-4412-83ce-9be5216e4404', '4df4b6fe-45ac-41fd-bd79-e553ed923a29'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a194abb1-1cc1-428e-86a4-3ba7476d64cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1569070309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb559e66dda4c4f91d935d1b8751681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:14Z,use_quota=True,user_id='12d846fce5bf433a962b9056d6599f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd3fb30-7c53-43d8-8d98-84f5231c8c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd3fb30-7c53-43d8-8d98-84f5231c8c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54293d0-6686-4e06-b46e-5b3fb746fe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54293d0-6686-4e06-b46e-5b3fb746fe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0', 'volume_name': 'volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d67971-0f04-4345-b25a-89d74ba5b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d67971-0f04-4345-b25a-89d74ba5b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d62c52-2b54-4458-990d-d6bb03372185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Volume 0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0', 'volume_size': 1} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1569070309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb559e66dda4c4f91d935d1b8751681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:14Z,use_quota=True,user_id='12d846fce5bf433a962b9056d6599f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Creating volume 0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:14 devstack sudo[95817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 1073741824 Sep 17 15:07:14 devstack sudo[95817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:14 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:14 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:14 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.288s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Deleted volume successfully. Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ac1e8b30-3198-47ff-a835-0c6eccdeb3d4 tempest-VolumesListAdminTestJSON-52301846 None] Lock "cinder-a99b872e-a881-4fe2-ab1b-79f2b8650c9b-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:14 devstack sudo[95817]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 1073741824" returned: 0 in 0.541s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:14 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 Sep 17 15:07:14 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:15 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.055s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d62c52-2b54-4458-990d-d6bb03372185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8bfb79-d5d3-49f7-8853-448f087d213c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fba7e6-5008-4892-b0e6-72b0aa154e8f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Volume volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 (0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0): created successfully Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8bfb79-d5d3-49f7-8853-448f087d213c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Flow 'volume_create_manager' (cb565fbf-35b6-41ba-822c-5aa7aab2764c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4d2c6f1e-56ea-4d65-862c-55ef957311da tempest-SnapshotMetadataTestJSON-254775826 None] Created volume successfully. Sep 17 15:07:15 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:15 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:15 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e349e9-d828-4ed4-8f1e-0e68661bf510]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:15 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:15 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:15 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.cf7e980e-2d65-4a82-bfc5-d2ccf61fa404gpk3fi3v.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:15 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.cf7e980e-2d65-4a82-bfc5-d2ccf61fa404gpk3fi3v.img Sep 17 15:07:15 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1d4d6f8d-3c86-4f6c-bbeb-6952adf2139b req-263d69b4-ce87-47fe-8e87-65eae1c5f184 tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:23 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.cf7e980e-2d65-4a82-bfc5-d2ccf61fa404gpk3fi3v.img" returned: 0 in 7.894s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e5358b-7943-4c37-990f-9eccc07c55ce]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:24 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:24 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Flow 'volume_create_manager' (a158b87f-44b0-4bea-b3ae-545fe6307d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4245c4e3-1ea3-48b4-9365-cef379b8cd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4245c4e3-1ea3-48b4-9365-cef379b8cd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1689904953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659d80ce-9f3a-448a-a1ed-602c42abc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfb8d81ca2444b2b9a5f37d187aec9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:24Z,use_quota=True,user_id='41bc049ba96d4510ab6db9a07a2873ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4c2620-cb76-487c-8385-4578d742d0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef4c2620-cb76-487c-8385-4578d742d0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e79302-66ea-4635-b55e-eb8d4b0698d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e79302-66ea-4635-b55e-eb8d4b0698d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659d80ce-9f3a-448a-a1ed-602c42abc30d', 'volume_name': 'volume-659d80ce-9f3a-448a-a1ed-602c42abc30d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797efa73-914d-4e61-9ed2-391c1b4bbeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797efa73-914d-4e61-9ed2-391c1b4bbeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf0ada0-aa34-4cb2-932a-2527f5f9a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Volume 659d80ce-9f3a-448a-a1ed-602c42abc30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659d80ce-9f3a-448a-a1ed-602c42abc30d', 'volume_size': 1} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:24 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.547s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b, size 1024.00 MB, duration 7.90 sec, destination /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.cf7e980e-2d65-4a82-bfc5-d2ccf61fa404gpk3fi3v.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:07:24 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Converted 1024.00 MB image at 129.70 MB/s Sep 17 15:07:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] cf7e980e-2d65-4a82-bfc5-d2ccf61fa404 was raw, no need to convert to raw {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 17 15:07:34 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=68,cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=7 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:07:34 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=55,cinder:INSERT=26,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.136s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Uploaded volume to glance image-id: cf7e980e-2d65-4a82-bfc5-d2ccf61fa404. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 25.763s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Creating offline snapshot 249af275-5687-487f-9d74-ce04938b8357 of volume 0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:07:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0ac06aa4-b488-4489-9295-0447fe96894e tempest-VolumesActionsTest-1093372887 None] Copy volume to image completed successfully. Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a8736c-35d1-477b-b814-43bd69b951c6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:42 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 Sep 17 15:07:42 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:42 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:42 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 1G Sep 17 15:07:42 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:43 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 1G" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:43 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 Sep 17 15:07:43 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:43 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:43 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 is being set with open permissions: ugo+rw Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:43 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 Sep 17 15:07:43 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:43 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:43 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info Sep 17 15:07:43 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:43 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:43 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info is being set with open permissions: ugo+rw Sep 17 15:07:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:44 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info Sep 17 15:07:44 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:44 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.info" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1d4d6f8d-3c86-4f6c-bbeb-6952adf2139b req-263d69b4-ce87-47fe-8e87-65eae1c5f184 tempest-TestStampPattern-1047644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 23.537s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-1d4d6f8d-3c86-4f6c-bbeb-6952adf2139b req-263d69b4-ce87-47fe-8e87-65eae1c5f184 tempest-TestStampPattern-1047644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.090s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1689904953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659d80ce-9f3a-448a-a1ed-602c42abc30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfb8d81ca2444b2b9a5f37d187aec9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:24Z,use_quota=True,user_id='41bc049ba96d4510ab6db9a07a2873ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Creating volume 659d80ce-9f3a-448a-a1ed-602c42abc30d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:07:44 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-62b82d5b-3de2-4023-8cf1-7a7795a60140 tempest-SnapshotMetadataTestJSON-254775826 None] Create snapshot completed successfully Sep 17 15:07:44 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d 1073741824 Sep 17 15:07:44 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-1d4d6f8d-3c86-4f6c-bbeb-6952adf2139b req-263d69b4-ce87-47fe-8e87-65eae1c5f184 tempest-TestStampPattern-1047644296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-9646f383-7448-4025-9fe4-6c90c71f1e44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '965b5a64-5b9d-44f6-bde8-a7a536de66fd', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:07:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-1d4d6f8d-3c86-4f6c-bbeb-6952adf2139b req-263d69b4-ce87-47fe-8e87-65eae1c5f184 tempest-TestStampPattern-1047644296 None] attachment_update completed successfully. Sep 17 15:07:44 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d 1073741824" returned: 0 in 0.495s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:44 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d Sep 17 15:07:44 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:45 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.102s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf0ada0-aa34-4cb2-932a-2527f5f9a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659d80ce-9f3a-448a-a1ed-602c42abc30d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275038b9-6bef-40d9-adc8-4a29e9c148ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a3a38-37dc-4605-a4c9-99dbe19a9e6b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Volume volume-659d80ce-9f3a-448a-a1ed-602c42abc30d (659d80ce-9f3a-448a-a1ed-602c42abc30d): created successfully Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275038b9-6bef-40d9-adc8-4a29e9c148ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Flow 'volume_create_manager' (a158b87f-44b0-4bea-b3ae-545fe6307d72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5ca2cf96-e039-405e-b1ba-68ba1397dcd2 tempest-AbsoluteLimitsTests-1735795051 None] Created volume successfully. Sep 17 15:07:45 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:45 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Acquiring lock "cinder-659d80ce-9f3a-448a-a1ed-602c42abc30d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "cinder-659d80ce-9f3a-448a-a1ed-602c42abc30d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:45 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.475s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb16f371-01a2-4436-a65c-a69032b7e923]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Acquiring lock "cinder-quobyte-659d80ce-9f3a-448a-a1ed-602c42abc30d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "cinder-quobyte-659d80ce-9f3a-448a-a1ed-602c42abc30d" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a7b7fd-ac38-4d2e-9ca4-24b64dbae2ec]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:45 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:45 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:45 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d Sep 17 15:07:45 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:46 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.467s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:46 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:46 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d Sep 17 15:07:46 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "cinder-249af275-5687-487f-9d74-ce04938b8357-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-249af275-5687-487f-9d74-ce04938b8357-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "cinder-quobyte-249af275-5687-487f-9d74-ce04938b8357" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-249af275-5687-487f-9d74-ce04938b8357" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Deleting offline snapshot 249af275-5687-487f-9d74-ce04938b8357 of volume 0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] snapshot_file for this snap is: volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bfa2c9-0983-4049-b5a7-1dc35c9278d5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-659d80ce-9f3a-448a-a1ed-602c42abc30d" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "cinder-quobyte-659d80ce-9f3a-448a-a1ed-602c42abc30d" released by "delete_volume" :: held 0.791s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Created reservations ['f7e36bc8-1229-4301-ab01-9daeb0386ec4', '6d938642-4bdb-4f49-b3ca-f932733aa824', '3f42ef47-5310-413f-97bd-8308eb6cc8dc', '557319e5-a58e-4503-bc88-32c7b4f9ac72'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:46 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 Sep 17 15:07:46 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:46 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:46 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:47 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357" returned: 0 in 0.742s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d358f99-8d1f-4244-bd2a-e2bb564cfa8b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:47 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.543s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Deleted volume successfully. Sep 17 15:07:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-35b16d72-70d6-4bc0-9f83-863ad043b93e tempest-AbsoluteLimitsTests-1735795051 None] Lock "cinder-659d80ce-9f3a-448a-a1ed-602c42abc30d-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:47 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 Sep 17 15:07:47 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:47 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" returned: 0 in 0.751s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:48 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 Sep 17 15:07:48 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:48 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357" returned: 0 in 0.946s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:48 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357 Sep 17 15:07:49 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:49 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0.249af275-5687-487f-9d74-ce04938b8357" returned: 0 in 0.454s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-249af275-5687-487f-9d74-ce04938b8357" released by "_delete_snapshot" :: held 3.178s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" released by "delete_snapshot" :: held 3.216s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:49 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Created reservations ['598d7bf4-d529-4b7e-921a-6d3dfb96de90', '62974763-43a8-4c87-b41d-1cd8620d9d90', 'eda22332-5151-4bba-b0ed-29218234d04a', '9ade1500-1885-483a-ac41-979e49ea9237'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Delete snapshot completed successfully. Sep 17 15:07:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2a8304e8-6c00-48d8-ac66-3c69c28e1772 tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-249af275-5687-487f-9d74-ce04938b8357-delete_snapshot" released by "delete_snapshot" :: held 3.510s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "cinder-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:07:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:07:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae238a76-92ef-4429-84f3-06b4f6d0b144]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:51 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 Sep 17 15:07:51 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c8773f99-9d6c-4f97-8894-eb4ead75dfe9 req-c8608da9-b6ff-4b83-ba95-366905d0ecea tempest-TestStampPattern-1047644296 None] Terminate volume connection completed successfully. Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c8773f99-9d6c-4f97-8894-eb4ead75dfe9 req-c8608da9-b6ff-4b83-ba95-366905d0ecea tempest-TestStampPattern-1047644296 None] Deleting attachment 965b5a64-5b9d-44f6-bde8-a7a536de66fd. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:07:52 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" returned: 0 in 0.955s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:52 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0 Sep 17 15:07:52 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:52 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" returned: 0 in 0.547s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-quobyte-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0" released by "delete_volume" :: held 1.731s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Created reservations ['87a376bf-c1c5-42c8-9563-82dedcf3f545', 'abb04515-d692-4425-b655-299fc627ced7', '3e799253-d660-46db-ab70-0652e6aa5478', '2b0f7198-98a7-46cc-80f1-a4d47e5f12b4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:53 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:53 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:53 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.520s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Deleted volume successfully. Sep 17 15:07:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-446f8c8b-518c-4291-ad18-fb7fdd40036e tempest-SnapshotMetadataTestJSON-254775826 None] Lock "cinder-0fa6b6a1-a7bb-476d-a1be-ac581bf3f8c0-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:07:55 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img" returned: 0 in 9.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:55 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f5642-a0dd-4533-b945-1d8339248723]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:55 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:07:55 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:56 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.609s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b, size 1024.00 MB, duration 9.37 sec, destination /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:07:56 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Converted 1024.00 MB image at 109.31 MB/s Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] 4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3 was raw, converting to qcow2 {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d61d6a-72e8-406a-8855-ee706abe8760]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:56 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img Sep 17 15:07:56 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:56 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:56 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img Sep 17 15:07:56 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Flow 'volume_create_manager' (7644a07d-3041-417c-a3c1-6dab13caf9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:56 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be679-98a9-409d-b518-5586aa1ae240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img" returned: 1 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:56 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj Sep 17 15:07:56 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (596be679-98a9-409d-b518-5586aa1ae240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-169086110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a4e198-2ca0-419e-9c10-1b061422da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12079c62649458e921a746bbbfaebde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:57Z,use_quota=True,user_id='c0f44f700dd14dc5b11adc19363dd722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6154143-07d1-467b-bff7-cf95719eff6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6154143-07d1-467b-bff7-cf95719eff6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20efe5-a42a-4213-9bff-c92930649c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d20efe5-a42a-4213-9bff-c92930649c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6a4e198-2ca0-419e-9c10-1b061422da2d', 'volume_name': 'volume-d6a4e198-2ca0-419e-9c10-1b061422da2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ea16d-a7c2-4c17-817f-0a66396105b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49ea16d-a7c2-4c17-817f-0a66396105b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d1f12-a669-462d-813e-1bf63167814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Volume d6a4e198-2ca0-419e-9c10-1b061422da2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6a4e198-2ca0-419e-9c10-1b061422da2d', 'volume_size': 1} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:57 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:07:57 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:57 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:07:57 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj" returned: 0 in 0.671s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Image conversion details: src /opt/stack/data/cinder/conversion/bf74031b-a7c7-45b4-a2be-0f4fead5cc6b.temp_image.4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3f4ok614b.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:07:57 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce177350-6779-4917-8b99-f88d1dd3d32b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:57 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj Sep 17 15:07:57 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:57 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ejyjg1mj" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Flow 'volume_create_manager' (4b13d7aa-041c-4fb0-bf19-03e9dedb5516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b09404-9e9c-4d16-a5c8-a2479b571674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b09404-9e9c-4d16-a5c8-a2479b571674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-355777749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b227bed9-ab75-44d2-a710-f0e9ed30d0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6684b55e2c744c1e9f84f41edbca6d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:59Z,use_quota=True,user_id='d6efd5175b0141bca01e751a8bb5392c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168c2f1e-fe34-42ca-bb23-dae01c6c1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (168c2f1e-fe34-42ca-bb23-dae01c6c1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fac1d4-0b84-4fdb-8d08-f3cf933c0389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fac1d4-0b84-4fdb-8d08-f3cf933c0389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b227bed9-ab75-44d2-a710-f0e9ed30d0ff', 'volume_name': 'volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c152cf-502d-432d-b761-ee24051e65bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c152cf-502d-432d-b761-ee24051e65bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b2bb9-d8fa-43b7-8e31-aebf0d040985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:07:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Volume b227bed9-ab75-44d2-a710-f0e9ed30d0ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff', 'volume_size': 1} Sep 17 15:07:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.157s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Uploaded volume to glance image-id: 4ec5ff19-0e7d-4a6b-94eb-b7e498ad44d3. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.160s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Creating offline snapshot ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b of volume 9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:07:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-82081f3a-785b-45aa-9082-c19291640e00 tempest-VolumesActionsTest-1093372887 None] Copy volume to image completed successfully. Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[658caa97-ffe9-402a-9284-da704a2818cf]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:59 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:07:59 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:07:59 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.368s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:07:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:07:59 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b 1G Sep 17 15:07:59 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b 1G" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9646f383-7448-4025-9fe4-6c90c71f1e44 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:00 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9646f383-7448-4025-9fe4-6c90c71f1e44 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:08:00 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9646f383-7448-4025-9fe4-6c90c71f1e44 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:00 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b is being set with open permissions: ugo+rw Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:00 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:08:00 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Acquiring lock "cinder-quobyte-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "cinder-quobyte-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c5d8b6-bad3-49d0-8426-db7046c545b4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:00 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:08:00 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:00 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info Sep 17 15:08:00 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:00 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b Sep 17 15:08:00 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:00 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info is being set with open permissions: ugo+rw Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info Sep 17 15:08:01 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:01 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "cinder-quobyte-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b" released by "delete_volume" :: held 0.675s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:01 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.info" returned: 0 in 0.247s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.303s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-169086110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6a4e198-2ca0-419e-9c10-1b061422da2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12079c62649458e921a746bbbfaebde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:57Z,use_quota=True,user_id='c0f44f700dd14dc5b11adc19363dd722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Creating volume d6a4e198-2ca0-419e-9c10-1b061422da2d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d 1073741824 Sep 17 15:08:01 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eed1a4e1-4f23-4972-9ce8-30131cdd3daa tempest-TestStampPattern-1047644296 None] Create snapshot completed successfully Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Created reservations ['a0c833a2-8065-4cb9-9e09-ad571855f61d', 'e3ca9280-62da-425c-9d05-d607d40172ce', '53c6ce8a-9099-418b-b467-8102ef2d2436', '889e3e12-9f19-40e7-ae73-b5ccd106e018'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:01 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:01 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Deleted volume successfully. Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cbd19c69-d916-48b4-b836-99313bd3270d tempest-VolumesActionsTest-1093372887 None] Lock "cinder-bf74031b-a7c7-45b4-a2be-0f4fead5cc6b-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:01 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d 1073741824" returned: 0 in 0.518s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:01 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d Sep 17 15:08:01 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:02 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.165s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-355777749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b227bed9-ab75-44d2-a710-f0e9ed30d0ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6684b55e2c744c1e9f84f41edbca6d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:07:59Z,use_quota=True,user_id='d6efd5175b0141bca01e751a8bb5392c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Creating volume b227bed9-ab75-44d2-a710-f0e9ed30d0ff {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a5d1f12-a669-462d-813e-1bf63167814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6a4e198-2ca0-419e-9c10-1b061422da2d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7373fbce-0757-439a-81be-07a5135c9031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:02 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff 1073741824 Sep 17 15:08:02 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Volume volume-d6a4e198-2ca0-419e-9c10-1b061422da2d (d6a4e198-2ca0-419e-9c10-1b061422da2d): created successfully Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7373fbce-0757-439a-81be-07a5135c9031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Flow 'volume_create_manager' (7644a07d-3041-417c-a3c1-6dab13caf9c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a0b4f7bc-7813-4cc6-8134-9cdffee488f4 tempest-VolumesNegativeTest-201944182 None] Created volume successfully. Sep 17 15:08:02 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff 1073741824" returned: 0 in 0.638s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:02 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff Sep 17 15:08:02 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:03 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b2bb9-d8fa-43b7-8e31-aebf0d040985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985405c-70b3-4c39-984b-a06d2c6f86d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Volume volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff (b227bed9-ab75-44d2-a710-f0e9ed30d0ff): created successfully Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6985405c-70b3-4c39-984b-a06d2c6f86d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Flow 'volume_create_manager' (4b13d7aa-041c-4fb0-bf19-03e9dedb5516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-86f9c6fc-22e7-4dee-8fa4-afeea72a7e28 tempest-VolumesMetadataTest-1888626840 None] Created volume successfully. Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Acquiring lock "cinder-b227bed9-ab75-44d2-a710-f0e9ed30d0ff-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "cinder-b227bed9-ab75-44d2-a710-f0e9ed30d0ff-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Acquiring lock "cinder-quobyte-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "cinder-quobyte-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf4bcff-701d-450f-854f-bf5eef21bd53]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:05 devstack sudo[96606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff Sep 17 15:08:05 devstack sudo[96606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:05 devstack sudo[96606]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" returned: 0 in 0.585s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff Sep 17 15:08:06 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:06 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "cinder-quobyte-b227bed9-ab75-44d2-a710-f0e9ed30d0ff" released by "delete_volume" :: held 1.141s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Created reservations ['57ac130b-72ab-4212-a371-4aa291fb5fec', 'a905f905-9663-47d8-9478-049babe11587', '0ffc1cbd-f0c2-4f39-bc5f-93d81997c418', 'a39e2bb3-8b92-4201-8863-028e639ff45a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:06 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:06 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:07 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Deleted volume successfully. Sep 17 15:08:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-95921c35-a1b3-4032-be02-64d6d6713d59 tempest-VolumesMetadataTest-1888626840 None] Lock "cinder-b227bed9-ab75-44d2-a710-f0e9ed30d0ff-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Flow 'volume_create_manager' (2d992859-b545-46a0-987b-8eda190e86e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb5de4-55ec-4789-9457-5b1078e860ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb5de4-55ec-4789-9457-5b1078e860ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1427334505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b1f26e-6f4e-4ae6-b156-0498b78e6376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c804c0331fb4d07aa325d5ea4f85c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:11Z,use_quota=True,user_id='74978caa70144160966645445f22cc56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f462ec3b-59e7-4702-a0c7-062d64b4b7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f462ec3b-59e7-4702-a0c7-062d64b4b7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb787084-4650-4cee-90cf-f2b0aee37dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb787084-4650-4cee-90cf-f2b0aee37dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4b1f26e-6f4e-4ae6-b156-0498b78e6376', 'volume_name': 'volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376', 'volume_size': 1, 'snapshot_id': 'ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf5e9de-6828-4267-984b-cd7fb5fcc4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf5e9de-6828-4267-984b-cd7fb5fcc4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f3139-3805-48db-bacf-f0154d163b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Volume c4b1f26e-6f4e-4ae6-b156-0498b78e6376: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376', 'volume_size': 1, 'snapshot_id': 'ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b'} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Creating volume c4b1f26e-6f4e-4ae6-b156-0498b78e6376 from snapshot ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] snapshot: ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b, volume: c4b1f26e-6f4e-4ae6-b156-0498b78e6376, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1f4616-46fe-4be0-b722-c1481b53c78f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:11 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:08:11 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:12 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.543s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9646f383-7448-4025-9fe4-6c90c71f1e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46fe016-724f-4a10-828e-437c3851c8ef]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:08:12 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:12 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.704s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:08:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:12 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 Sep 17 15:08:12 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Flow 'volume_create_manager' (5800943d-a5f6-4895-b237-653cd7dcd34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9d18c9-777e-47a7-9140-eeb76b7d0f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9d18c9-777e-47a7-9140-eeb76b7d0f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-483633782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3e46b3-d69b-4767-9375-15566fe19e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed375542e7014abf8a7c5ff3f7213fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:16Z,use_quota=True,user_id='9152c374c098413fb5668dc2a2e548d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338718e0-faf0-4a63-9e80-de206ba924be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (338718e0-faf0-4a63-9e80-de206ba924be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910ebc98-a960-47da-a7d0-34636d121f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910ebc98-a960-47da-a7d0-34636d121f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3e46b3-d69b-4767-9375-15566fe19e6f', 'volume_name': 'volume-bf3e46b3-d69b-4767-9375-15566fe19e6f', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddf013f-4177-4f23-811f-abdd1135ff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddf013f-4177-4f23-811f-abdd1135ff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad09094-5c75-4528-af28-8c6c91a1b6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Volume bf3e46b3-d69b-4767-9375-15566fe19e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3e46b3-d69b-4767-9375-15566fe19e6f', 'volume_size': 2} Sep 17 15:08:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Flow 'volume_create_manager' (faa3605f-f2e7-4d6a-a2d3-2192464f6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fd834e-75f3-46a7-a0cf-a3dc61a29043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55fd834e-75f3-46a7-a0cf-a3dc61a29043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1622101135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49ce9cd425f493991fe090aa282d75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:22Z,use_quota=True,user_id='b191ff85addd47daa214e78cae268fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef8ec7f-89f1-46b4-b3d6-f787970310e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef8ec7f-89f1-46b4-b3d6-f787970310e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544d3f2-8ea4-4388-bf2d-4b2534b0325a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e544d3f2-8ea4-4388-bf2d-4b2534b0325a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4', 'volume_name': 'volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232b6dfb-7c7f-46c7-8a6c-f141ee0b15b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232b6dfb-7c7f-46c7-8a6c-f141ee0b15b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567d7437-724f-4554-85e8-ddb5cf9d010d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Volume 8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4', 'volume_size': 1} Sep 17 15:08:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:25 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" returned: 0 in 12.812s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44, size 1024.00 MB, duration 12.81 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:08:25 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Converted 1024.00 MB image at 79.92 MB/s Sep 17 15:08:25 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 is being set with open permissions: ugo+rw Sep 17 15:08:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:25 devstack sudo[96795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 Sep 17 15:08:25 devstack sudo[96795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:25 devstack sudo[96795]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" returned: 0 in 0.305s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" released by "_copy_volume_from_snapshot" :: held 14.559s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" released by "_create_volume_from_snapshot" :: held 14.659s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.691s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.319s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-483633782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3e46b3-d69b-4767-9375-15566fe19e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed375542e7014abf8a7c5ff3f7213fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:16Z,use_quota=True,user_id='9152c374c098413fb5668dc2a2e548d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Creating volume bf3e46b3-d69b-4767-9375-15566fe19e6f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f 2147483648 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:26 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f 2147483648 Sep 17 15:08:26 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241f3139-3805-48db-bacf-f0154d163b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376', 'volume_size': 1, 'snapshot_id': 'ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9365a904-f8eb-49dd-a38a-ca60f0245a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Volume volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 (c4b1f26e-6f4e-4ae6-b156-0498b78e6376): created successfully Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9365a904-f8eb-49dd-a38a-ca60f0245a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Flow 'volume_create_manager' (2d992859-b545-46a0-987b-8eda190e86e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-651b9324-fa3b-4dbf-b608-c9d6e2d0da9d tempest-TestStampPattern-1047644296 None] Created volume successfully. Sep 17 15:08:27 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f 2147483648" returned: 0 in 1.011s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:27 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f Sep 17 15:08:27 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:27 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.883s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1622101135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49ce9cd425f493991fe090aa282d75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:22Z,use_quota=True,user_id='b191ff85addd47daa214e78cae268fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Creating volume 8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad09094-5c75-4528-af28-8c6c91a1b6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3e46b3-d69b-4767-9375-15566fe19e6f', 'volume_size': 2}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:27 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 1073741824 Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48600d6c-03d4-473b-8102-c3c9bc7c9246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:27 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Volume volume-bf3e46b3-d69b-4767-9375-15566fe19e6f (bf3e46b3-d69b-4767-9375-15566fe19e6f): created successfully Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48600d6c-03d4-473b-8102-c3c9bc7c9246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Flow 'volume_create_manager' (5800943d-a5f6-4895-b237-653cd7dcd34d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-55caa27b-08d4-4015-955c-5a2809a9dff5 tempest-VolumesCloneNegativeTest-450772298 None] Created volume successfully. Sep 17 15:08:28 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 1073741824" returned: 0 in 0.608s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:28 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 Sep 17 15:08:28 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:28 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567d7437-724f-4554-85e8-ddb5cf9d010d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d624aa19-553e-4cc7-9d82-6a82b03e8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Volume volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 (8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4): created successfully Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d624aa19-553e-4cc7-9d82-6a82b03e8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Flow 'volume_create_manager' (faa3605f-f2e7-4d6a-a2d3-2192464f6458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a95dc1c-d836-46b7-a426-d89cddef9282 tempest-VolumesTransfersTest-1729557044 None] Created volume successfully. Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Acquiring lock "cinder-bf3e46b3-d69b-4767-9375-15566fe19e6f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "cinder-bf3e46b3-d69b-4767-9375-15566fe19e6f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Acquiring lock "cinder-quobyte-bf3e46b3-d69b-4767-9375-15566fe19e6f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "cinder-quobyte-bf3e46b3-d69b-4767-9375-15566fe19e6f" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ab8022-b936-43e2-9934-9d02cf65cc2c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:29 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f Sep 17 15:08:29 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dce11a69-183d-40dd-9f78-02ae23153a02 tempest-VolumesTransfersTest-299007646 None] Transfer volume completed successfully. Sep 17 15:08:30 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f" returned: 0 in 0.675s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:30 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f Sep 17 15:08:30 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:30 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bf3e46b3-d69b-4767-9375-15566fe19e6f" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "cinder-quobyte-bf3e46b3-d69b-4767-9375-15566fe19e6f" released by "delete_volume" :: held 1.124s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Created reservations ['7e68be7a-11c7-4e0b-ae2a-ad194a21eb09', 'da54bc24-8b3e-403e-a86e-9b28f43bf125', 'c5356b51-2556-4cce-8f44-96c8a4ca0e98', '4ccc3e98-ec72-4a40-905f-c0a71c1cac6f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:30 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:30 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "cinder-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "cinder-quobyte-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-quobyte-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:31 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.494s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[271381e2-d496-403b-aaad-1ce3df4923ad]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Deleted volume successfully. Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-eecedf27-194d-4e98-80a9-2845e3ba9f3e tempest-VolumesCloneNegativeTest-450772298 None] Lock "cinder-bf3e46b3-d69b-4767-9375-15566fe19e6f-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:31 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 Sep 17 15:08:31 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:31 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" returned: 0 in 0.498s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:31 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4 Sep 17 15:08:31 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:32 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" returned: 0 in 0.472s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-quobyte-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4" released by "delete_volume" :: held 1.053s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Created reservations ['6b50d68a-3e96-4c99-870b-34bd3ab12008', '62788f09-57a2-4a12-9b22-7b29f1983608', '40ff17cc-cc66-4ac0-aac6-8151edbb2085', 'a64d6bf3-2a83-47d0-88f9-f36b83539fcd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:32 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:32 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:32 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Deleted volume successfully. Sep 17 15:08:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-69bf18b5-0350-4915-b05e-330cb38e2e3f tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-8f9c78e0-c573-42e8-ae94-cf24a4bcdbc4-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Flow 'volume_create_manager' (e4c6d12a-ebc3-484a-93d2-b7e9174676b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c5342a-e4d3-4dd7-86f8-149a39e682d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c5342a-e4d3-4dd7-86f8-149a39e682d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1665759174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca373a6e-848b-413e-9a86-93cb9d2aed99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49ce9cd425f493991fe090aa282d75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:34Z,use_quota=True,user_id='b191ff85addd47daa214e78cae268fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e085a52-3e24-4f00-b6da-ae494ee58ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e085a52-3e24-4f00-b6da-ae494ee58ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320cb763-14db-4ec0-bafe-889b4d3ffc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (320cb763-14db-4ec0-bafe-889b4d3ffc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca373a6e-848b-413e-9a86-93cb9d2aed99', 'volume_name': 'volume-ca373a6e-848b-413e-9a86-93cb9d2aed99', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b78634-e98c-43f6-94ac-188e4964fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8b78634-e98c-43f6-94ac-188e4964fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03ce245-54b6-44b1-a60b-bed8d2ee5992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Volume ca373a6e-848b-413e-9a86-93cb9d2aed99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca373a6e-848b-413e-9a86-93cb9d2aed99', 'volume_size': 1} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1665759174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca373a6e-848b-413e-9a86-93cb9d2aed99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e49ce9cd425f493991fe090aa282d75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:34Z,use_quota=True,user_id='b191ff85addd47daa214e78cae268fb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Creating volume ca373a6e-848b-413e-9a86-93cb9d2aed99 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:34 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 1073741824 Sep 17 15:08:34 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:35 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 1073741824" returned: 0 in 0.641s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=69,cinder:UPDATE=70,cinder:INSERT=20,cinder:DELETE=6 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=63,cinder:UPDATE=85,cinder:DELETE=8,cinder:INSERT=16 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:35 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 Sep 17 15:08:35 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:35 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03ce245-54b6-44b1-a60b-bed8d2ee5992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca373a6e-848b-413e-9a86-93cb9d2aed99', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f668bfa-fde3-4145-ac76-62a0565bcc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Volume volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 (ca373a6e-848b-413e-9a86-93cb9d2aed99): created successfully Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f668bfa-fde3-4145-ac76-62a0565bcc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Flow 'volume_create_manager' (e4c6d12a-ebc3-484a-93d2-b7e9174676b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f23c385a-8054-48d3-a7a2-1d5bbd8a128f tempest-VolumesTransfersTest-1729557044 None] Created volume successfully. Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Acquiring lock "cinder-d6a4e198-2ca0-419e-9c10-1b061422da2d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "cinder-d6a4e198-2ca0-419e-9c10-1b061422da2d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Acquiring lock "cinder-quobyte-d6a4e198-2ca0-419e-9c10-1b061422da2d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "cinder-quobyte-d6a4e198-2ca0-419e-9c10-1b061422da2d" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5daee18-9f28-4e81-aa30-97d866df1f76]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:36 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d Sep 17 15:08:36 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "cinder-ca373a6e-848b-413e-9a86-93cb9d2aed99-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-ca373a6e-848b-413e-9a86-93cb9d2aed99-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:37 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d" returned: 0 in 0.580s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "cinder-quobyte-ca373a6e-848b-413e-9a86-93cb9d2aed99" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-quobyte-ca373a6e-848b-413e-9a86-93cb9d2aed99" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:37 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d Sep 17 15:08:37 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba52c5be-0681-43fa-a940-9adb83541aa2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:37 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 Sep 17 15:08:37 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:37 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d6a4e198-2ca0-419e-9c10-1b061422da2d" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "cinder-quobyte-d6a4e198-2ca0-419e-9c10-1b061422da2d" released by "delete_volume" :: held 0.975s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Created reservations ['43fb42ce-d324-4aab-9251-5ab021a4d38e', 'e58e46b8-18bc-40fe-be4b-f1eef4b73518', '75281cc3-cfb1-4c87-a3c4-b9844d2e89d7', '8ff27064-2fef-4a8f-844d-42d11e03b4c8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:37 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:37 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:37 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99" returned: 0 in 0.511s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:37 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99 Sep 17 15:08:37 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:37 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Deleted volume successfully. Sep 17 15:08:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-5d168f10-2950-4050-8ef5-3632f26a6d59 tempest-VolumesNegativeTest-201944182 None] Lock "cinder-d6a4e198-2ca0-419e-9c10-1b061422da2d-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:37 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ca373a6e-848b-413e-9a86-93cb9d2aed99" returned: 0 in 0.342s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-quobyte-ca373a6e-848b-413e-9a86-93cb9d2aed99" released by "delete_volume" :: held 0.926s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Created reservations ['c11da9ab-97fe-4ed9-8569-3185639bc7f0', '28037a6a-f38a-45db-b3b7-5be415e6249a', 'be960b99-73ce-4663-8694-f8ff196c4403', '6ce15dea-ee8c-49b2-afbf-67ab92ff2c81'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:38 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:38 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:38 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Deleted volume successfully. Sep 17 15:08:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-06ec4379-8097-4fdd-b63b-865ee3aacfcf tempest-VolumesTransfersTest-1336096045 None] Lock "cinder-ca373a6e-848b-413e-9a86-93cb9d2aed99-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:08:48 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=17 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:48 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=19,cinder:DELETE=3,cinder:SELECT=6,cinder:INSERT=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Flow 'volume_create_manager' (b35851c8-cc43-4bdd-a261-a6901720c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752205d-536e-4457-9fe0-ac61e794479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f752205d-536e-4457-9fe0-ac61e794479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1683666239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497b2b6b-ab66-4c92-9cac-ba0c51136af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387450864aad4ee49c9d2c3ca0a459f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:50Z,use_quota=True,user_id='e480ceebf104417b8c53309dc3b9cd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431f9ff3-9c2e-4d81-9707-135804646025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431f9ff3-9c2e-4d81-9707-135804646025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7af5f2-8dcb-4dbb-98c7-21face5de73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7af5f2-8dcb-4dbb-98c7-21face5de73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'volume_name': 'volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add269d5-662c-4ce7-b7a7-cfc8e6f519d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (add269d5-662c-4ce7-b7a7-cfc8e6f519d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4049861a-be8d-4688-8229-182795010a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Volume 497b2b6b-ab66-4c92-9cac-ba0c51136af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'volume_size': 1} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1683666239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497b2b6b-ab66-4c92-9cac-ba0c51136af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387450864aad4ee49c9d2c3ca0a459f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:50Z,use_quota=True,user_id='e480ceebf104417b8c53309dc3b9cd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Creating volume 497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:08:50 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:50 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 1073741824 Sep 17 15:08:50 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:50 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 1073741824" returned: 0 in 0.559s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:51 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:08:51 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:51 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4049861a-be8d-4688-8229-182795010a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8c7984-7b2a-485b-8f4b-a4009b45eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Volume volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 (497b2b6b-ab66-4c92-9cac-ba0c51136af7): created successfully Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b8c7984-7b2a-485b-8f4b-a4009b45eab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Flow 'volume_create_manager' (b35851c8-cc43-4bdd-a261-a6901720c230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fe474baf-b5b1-4993-a513-325cffe3d814 tempest-VolumesCloneTest-1318352183 None] Created volume successfully. Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Flow 'volume_create_manager' (781f3ff0-2ed2-44c9-9218-e585245fb344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d232b6-9b04-4637-becb-deafa837a5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94d232b6-9b04-4637-becb-deafa837a5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1904687160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9829b4a-221e-4f88-9806-2e9a3bf0b98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387450864aad4ee49c9d2c3ca0a459f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=497b2b6b-ab66-4c92-9cac-ba0c51136af7,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:53Z,use_quota=True,user_id='e480ceebf104417b8c53309dc3b9cd46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110554f-db56-4533-9ed6-97d7495d7460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b110554f-db56-4533-9ed6-97d7495d7460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f69fcd0-64bc-4b85-b3c2-9120fb094878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f69fcd0-64bc-4b85-b3c2-9120fb094878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9829b4a-221e-4f88-9806-2e9a3bf0b98d', 'volume_name': 'volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d', 'volume_size': 2, 'source_volid': '497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f651fc-a060-48ef-be1b-9b5668121b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f651fc-a060-48ef-be1b-9b5668121b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e71b73-9a99-486b-b3e9-ad085e1829b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Volume f9829b4a-221e-4f88-9806-2e9a3bf0b98d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d', 'volume_size': 2, 'source_volid': '497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'source_volstatus': 'available'} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:53 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Cloning volume 497b2b6b-ab66-4c92-9cac-ba0c51136af7 to volume f9829b4a-221e-4f88-9806-2e9a3bf0b98d Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Creating offline snapshot 04556a23-cf3d-4ec5-a2c8-29310f33f731 of volume 497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e54896-66b6-431e-b676-6977a6220b1f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:53 devstack sudo[96981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:08:53 devstack sudo[96981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:54 devstack sudo[96981]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.739s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:54 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 1G Sep 17 15:08:54 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:55 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 1G" returned: 0 in 0.751s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:55 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:08:55 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:08:55 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (d287c091-eaeb-45c1-92f1-bc07d72c757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e77108a-0015-4e46-931b-b8dd1ae90122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.670s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:55 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 is being set with open permissions: ugo+rw Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e77108a-0015-4e46-931b-b8dd1ae90122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742564991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b221c2-5ea4-42c1-8012-1b9be7d199c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:56Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3989a4df-da62-4950-aa1f-7ea28b81b2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:55 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:08:55 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3989a4df-da62-4950-aa1f-7ea28b81b2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f88e270-3aa6-4ee9-9921-f0ae1921b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f88e270-3aa6-4ee9-9921-f0ae1921b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5b221c2-5ea4-42c1-8012-1b9be7d199c4', 'volume_name': 'volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62798f-d988-4eed-95ea-f14912c9130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b62798f-d988-4eed-95ea-f14912c9130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8d8914-1725-42d6-b27c-70914fead9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:08:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Volume c5b221c2-5ea4-42c1-8012-1b9be7d199c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4', 'volume_size': 1} Sep 17 15:08:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:56 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:56 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info Sep 17 15:08:56 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:56 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info is being set with open permissions: ugo+rw Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:56 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info Sep 17 15:08:56 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:56 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.info" returned: 0 in 0.330s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] snapshot: 04556a23-cf3d-4ec5-a2c8-29310f33f731, volume: f9829b4a-221e-4f88-9806-2e9a3bf0b98d, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[62832dde-9a59-4008-afe2-390735d9f078]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:08:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:57 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:08:57 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:57 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:08:57 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:57 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:57 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe6a472-bba7-4c58-8dec-f8c3485bd69e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:57 devstack sudo[97014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:08:57 devstack sudo[97014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:08:57 devstack sudo[97014]: pam_unix(sudo:session): session closed for user root Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:08:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:08:57 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d Sep 17 15:08:57 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:05 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" returned: 0 in 7.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:09:05 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Converted 1024.00 MB image at 138.17 MB/s Sep 17 15:09:05 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d is being set with open permissions: ugo+rw Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:05 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d Sep 17 15:09:05 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:05 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" released by "_copy_volume_from_snapshot" :: held 8.716s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-quobyte-04556a23-cf3d-4ec5-a2c8-29310f33f731" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-04556a23-cf3d-4ec5-a2c8-29310f33f731" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Deleting offline snapshot 04556a23-cf3d-4ec5-a2c8-29310f33f731 of volume 497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] snapshot_file for this snap is: volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77a873d-ed8b-4c57-9460-8b222f2d91b9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:05 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:09:05 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:05 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6268a2b-5d72-4ecc-8bba-48abeb5d0825]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1,cinder:INSERT=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:09:06 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:09:06 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:06 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.597s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:06 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:09:06 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:06 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:06 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731 Sep 17 15:09:06 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:07 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7.04556a23-cf3d-4ec5-a2c8-29310f33f731" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-04556a23-cf3d-4ec5-a2c8-29310f33f731" released by "_delete_snapshot" :: held 1.704s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.860s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.483s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-742564991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5b221c2-5ea4-42c1-8012-1b9be7d199c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:08:56Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Creating volume c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:07 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:07 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 1073741824 Sep 17 15:09:07 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69e71b73-9a99-486b-b3e9-ad085e1829b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d', 'volume_size': 2, 'source_volid': '497b2b6b-ab66-4c92-9cac-ba0c51136af7', 'source_volstatus': 'available'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aeac35-0ccc-4a47-a10c-972e0b14d454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Volume volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d (f9829b4a-221e-4f88-9806-2e9a3bf0b98d): created successfully Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8aeac35-0ccc-4a47-a10c-972e0b14d454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Flow 'volume_create_manager' (781f3ff0-2ed2-44c9-9218-e585245fb344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e9abca41-d93e-41fe-a2a9-3345a309b0f8 tempest-VolumesCloneTest-1318352183 None] Created volume successfully. Sep 17 15:09:07 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 1073741824" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:07 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 Sep 17 15:09:07 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-f9829b4a-221e-4f88-9806-2e9a3bf0b98d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "cinder-f9829b4a-221e-4f88-9806-2e9a3bf0b98d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:08 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0958419-2222-430b-b1ba-77d00b27b9de]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8d8914-1725-42d6-b27c-70914fead9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb54734-34fb-4ee4-a467-2c024ea936c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:08 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Volume volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 (c5b221c2-5ea4-42c1-8012-1b9be7d199c4): created successfully Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb54734-34fb-4ee4-a467-2c024ea936c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (d287c091-eaeb-45c1-92f1-bc07d72c757c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a39f1c3-5f4e-4b36-8526-2380d910fecf tempest-VolumesSnapshotTestJSON-2133879486 None] Created volume successfully. Sep 17 15:09:08 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d Sep 17 15:09:08 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:08 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:08 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d Sep 17 15:09:08 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:08 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-f9829b4a-221e-4f88-9806-2e9a3bf0b98d" released by "delete_volume" :: held 0.760s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Created reservations ['aeeb19bf-fe1c-4da8-b1fb-20a381b0a9b8', 'e4233985-3070-4585-b03e-4f196e84beec', 'ede028b1-4cff-4e28-9e52-38df4c911148', 'fca0b893-b184-4387-a0c5-300943dfa392'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:09 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:09 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating offline snapshot ee8fe898-685f-4b17-bf90-615f47ee0017 of volume c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[40087fcc-b93a-4d0c-8b42-66ac1bdc4ce3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-497b2b6b-ab66-4c92-9cac-ba0c51136af7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "cinder-497b2b6b-ab66-4c92-9cac-ba0c51136af7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:09 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 Sep 17 15:09:09 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:09 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Deleted volume successfully. Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Acquiring lock "cinder-quobyte-497b2b6b-ab66-4c92-9cac-ba0c51136af7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b72472ef-9b92-4bfb-bcda-4756e64ab3ad tempest-VolumesCloneTest-1318352183 None] Lock "cinder-f9829b4a-221e-4f88-9806-2e9a3bf0b98d-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-497b2b6b-ab66-4c92-9cac-ba0c51136af7" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7296b-5a51-4387-87cf-7ac7542157ae]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:09 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:09 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:09 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:09 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 1G Sep 17 15:09:09 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:10 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.503s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:10 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7 Sep 17 15:09:10 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:10 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 1G" returned: 0 in 0.680s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:10 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-497b2b6b-ab66-4c92-9cac-ba0c51136af7" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:10 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 Sep 17 15:09:10 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "cinder-quobyte-497b2b6b-ab66-4c92-9cac-ba0c51136af7" released by "delete_volume" :: held 0.999s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-70ede838-863f-4ae9-8495-87472b389d50 req-3b4d6899-e2dc-47ef-bdd1-d00082c15281 tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Created reservations ['f6ed5964-760b-4966-a44d-77eaf97dbe60', 'bb37c22b-ab43-45f9-9c7b-319d0b465506', '9a042835-d379-4d0e-bd96-4309478388bf', 'ab919c6d-6c52-4f93-a613-6b6dcee38c0e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:10 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:10 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:10 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:10 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 is being set with open permissions: ugo+rw Sep 17 15:09:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:10 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 Sep 17 15:09:10 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:11 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Deleted volume successfully. Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8edac174-1a9e-49c6-819a-4bbb7cf2257c tempest-VolumesCloneTest-1318352183 None] Lock "cinder-497b2b6b-ab66-4c92-9cac-ba0c51136af7-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:11 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:11 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info Sep 17 15:09:11 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:11 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:11 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info is being set with open permissions: ugo+rw Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:11 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info Sep 17 15:09:11 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:11 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.info" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-70ede838-863f-4ae9-8495-87472b389d50 req-3b4d6899-e2dc-47ef-bdd1-d00082c15281 tempest-TestStampPattern-1047644296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.275s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-70ede838-863f-4ae9-8495-87472b389d50 req-3b4d6899-e2dc-47ef-bdd1-d00082c15281 tempest-TestStampPattern-1047644296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Flow 'volume_create_manager' (4e5d9d28-2cce-44fa-9191-79c54bc36cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579fd381-f8c1-4ec7-9a4f-acc194c415c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579fd381-f8c1-4ec7-9a4f-acc194c415c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480848516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842178f8-08f8-49d4-bbad-dde89dfbf263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb48dc2fe9d4160b92b9c1c9e9a05d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:12Z,use_quota=True,user_id='e8608ffab0fe45ceaa7a190a8d3d4bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f55d75-2b0d-41a7-9623-08d23009ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f55d75-2b0d-41a7-9623-08d23009ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1a5f16-3c23-4234-ab87-3f5f5fc448c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b1a5f16-3c23-4234-ab87-3f5f5fc448c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '842178f8-08f8-49d4-bbad-dde89dfbf263', 'volume_name': 'volume-842178f8-08f8-49d4-bbad-dde89dfbf263', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4c66c4-221d-4c60-8dec-69506ca2e6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4c66c4-221d-4c60-8dec-69506ca2e6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85f2a42-01c5-4690-95a5-4ceff696a312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume 842178f8-08f8-49d4-bbad-dde89dfbf263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-842178f8-08f8-49d4-bbad-dde89dfbf263', 'volume_size': 1} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-480848516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=842178f8-08f8-49d4-bbad-dde89dfbf263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb48dc2fe9d4160b92b9c1c9e9a05d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:12Z,use_quota=True,user_id='e8608ffab0fe45ceaa7a190a8d3d4bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Creating volume 842178f8-08f8-49d4-bbad-dde89dfbf263 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-70ede838-863f-4ae9-8495-87472b389d50 req-3b4d6899-e2dc-47ef-bdd1-d00082c15281 tempest-TestStampPattern-1047644296 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23e5b7e7-0007-47eb-8386-4e25f193f8c9', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:09:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a122881b-3b4d-4c6e-8f0e-33f0b32b4df3 tempest-VolumesSnapshotTestJSON-2133879486 None] Create snapshot completed successfully Sep 17 15:09:12 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 1073741824 Sep 17 15:09:12 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-70ede838-863f-4ae9-8495-87472b389d50 req-3b4d6899-e2dc-47ef-bdd1-d00082c15281 tempest-TestStampPattern-1047644296 None] attachment_update completed successfully. Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Flow 'volume_create_manager' (2a047c98-ff70-4d34-8b42-95b3fa51d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7d3c4-bbfb-4298-8792-2d99ecc4d99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b7d3c4-bbfb-4298-8792-2d99ecc4d99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-888905502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a70d84-90d2-4a7d-9d6d-1025eed65386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb48dc2fe9d4160b92b9c1c9e9a05d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:12Z,use_quota=True,user_id='e8608ffab0fe45ceaa7a190a8d3d4bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fd41a8-2adf-4643-a385-bbb84ba28b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13fd41a8-2adf-4643-a385-bbb84ba28b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d99ecc-470f-4d28-a0a6-c1658a0b9bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2d99ecc-470f-4d28-a0a6-c1658a0b9bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14a70d84-90d2-4a7d-9d6d-1025eed65386', 'volume_name': 'volume-14a70d84-90d2-4a7d-9d6d-1025eed65386', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fb0651-467a-48ce-9aed-1aa5227cd48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0fb0651-467a-48ce-9aed-1aa5227cd48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7e8622-fc07-42f0-9100-602b2e8865fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume 14a70d84-90d2-4a7d-9d6d-1025eed65386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14a70d84-90d2-4a7d-9d6d-1025eed65386', 'volume_size': 1} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:12 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 1073741824" returned: 0 in 0.724s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:12 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 Sep 17 15:09:12 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-ee8fe898-685f-4b17-bf90-615f47ee0017-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-ee8fe898-685f-4b17-bf90-615f47ee0017-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:13 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263" returned: 0 in 0.476s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-888905502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14a70d84-90d2-4a7d-9d6d-1025eed65386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb48dc2fe9d4160b92b9c1c9e9a05d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:12Z,use_quota=True,user_id='e8608ffab0fe45ceaa7a190a8d3d4bd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Creating volume 14a70d84-90d2-4a7d-9d6d-1025eed65386 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:13 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 1073741824 Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85f2a42-01c5-4690-95a5-4ceff696a312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-842178f8-08f8-49d4-bbad-dde89dfbf263', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:13 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de096d12-d342-4a57-945b-5138e06820cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" acquired by "delete_snapshot" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-ee8fe898-685f-4b17-bf90-615f47ee0017" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume volume-842178f8-08f8-49d4-bbad-dde89dfbf263 (842178f8-08f8-49d4-bbad-dde89dfbf263): created successfully Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de096d12-d342-4a57-945b-5138e06820cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Flow 'volume_create_manager' (4e5d9d28-2cce-44fa-9191-79c54bc36cb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ee8fe898-685f-4b17-bf90-615f47ee0017" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Deleting offline snapshot ee8fe898-685f-4b17-bf90-615f47ee0017 of volume c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] snapshot_file for this snap is: volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:09:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-62b20df2-cc78-455a-8fe4-edb285c9a484 tempest-TestServerVolumeAttachmentScenario-169582370 None] Created volume successfully. Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b6f03-7b66-4d62-a75b-d25684fd632e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:13 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 Sep 17 15:09:13 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:14 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:14 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 1073741824" returned: 0 in 0.795s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017" returned: 0 in 0.594s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[940f3b37-13e1-4297-b3d4-af4ba7678deb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:14 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 Sep 17 15:09:14 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:14 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 Sep 17 15:09:14 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:14 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.329s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7e8622-fc07-42f0-9100-602b2e8865fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14a70d84-90d2-4a7d-9d6d-1025eed65386', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c978b7c-7445-4a30-8692-1356633525a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Volume volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 (14a70d84-90d2-4a7d-9d6d-1025eed65386): created successfully Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c978b7c-7445-4a30-8692-1356633525a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Flow 'volume_create_manager' (2a047c98-ff70-4d34-8b42-95b3fa51d880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d415e98c-99e7-4cf0-93b0-047d97788176 tempest-TestServerVolumeAttachmentScenario-169582370 None] Created volume successfully. Sep 17 15:09:14 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" returned: 0 in 0.582s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:14 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 Sep 17 15:09:14 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:15 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:15 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017 Sep 17 15:09:15 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:15 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4.ee8fe898-685f-4b17-bf90-615f47ee0017" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ee8fe898-685f-4b17-bf90-615f47ee0017" released by "_delete_snapshot" :: held 2.178s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" released by "delete_snapshot" :: held 2.246s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['8da3b734-a121-4968-baa4-38af8e500f2d', 'bb26b6db-6075-41a1-bf74-2810657af71c', '6cb72634-713a-4fce-a7f7-06bfd0140aac', 'ac555eca-60b4-4c25-ad95-32bca7f80440'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Delete snapshot completed successfully. Sep 17 15:09:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f224bf52-9aaa-46e7-9784-010feb1c26bd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-ee8fe898-685f-4b17-bf90-615f47ee0017-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-7e6fa70d-e5f9-466f-a487-15336ed3b6fb req-9ceb5ae3-e734-4314-b086-c2e7abf722f6 tempest-TestStampPattern-1047644296 None] Terminate volume connection completed successfully. Sep 17 15:09:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-7e6fa70d-e5f9-466f-a487-15336ed3b6fb req-9ceb5ae3-e734-4314-b086-c2e7abf722f6 tempest-TestStampPattern-1047644296 None] Deleting attachment 23e5b7e7-0007-47eb-8386-4e25f193f8c9. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (5a5e4a88-1bd2-413e-9546-96ecbfb5d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc19f9a3-2085-4a2e-86e1-81e519d1174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc19f9a3-2085-4a2e-86e1-81e519d1174b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1626194389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604acbe6-7b83-4ce1-bc58-56376fd407ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:17Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3bccad-0a93-46a8-9c82-35417e3a1116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de3bccad-0a93-46a8-9c82-35417e3a1116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3278a6-0112-47a5-8ae2-4af6f340364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3278a6-0112-47a5-8ae2-4af6f340364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604acbe6-7b83-4ce1-bc58-56376fd407ff', 'volume_name': 'volume-604acbe6-7b83-4ce1-bc58-56376fd407ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3506f4-8071-4bb7-bb9b-75933ae7b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3506f4-8071-4bb7-bb9b-75933ae7b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f36cd0-4dcb-4d94-a7f7-6e928a41e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume 604acbe6-7b83-4ce1-bc58-56376fd407ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604acbe6-7b83-4ce1-bc58-56376fd407ff', 'volume_size': 1} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1626194389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=604acbe6-7b83-4ce1-bc58-56376fd407ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:17Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating volume 604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:17 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:17 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff 1073741824 Sep 17 15:09:17 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (9386e25f-f36b-4095-8272-b8b9f5983bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35f7693-17cb-42fb-a15c-a24c1b35ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35f7693-17cb-42fb-a15c-a24c1b35ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-956008671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:18Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af18946b-4371-4d13-8039-36d4607a22ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af18946b-4371-4d13-8039-36d4607a22ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034544e2-2495-49ab-9ff4-3753c45705a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034544e2-2495-49ab-9ff4-3753c45705a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01', 'volume_name': 'volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9a8c5-b151-4fec-ba82-efacad6438a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d9a8c5-b151-4fec-ba82-efacad6438a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadbbbb9-8c38-467f-ba82-a8a5d488c8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Volume 2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01', 'volume_size': 1} Sep 17 15:09:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:18 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff 1073741824" returned: 0 in 0.715s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:18 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:18 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:18 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-956008671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:18Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Creating volume 2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:18 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 1073741824 Sep 17 15:09:18 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f36cd0-4dcb-4d94-a7f7-6e928a41e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604acbe6-7b83-4ce1-bc58-56376fd407ff', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a44983-9d44-4094-a6e5-29e711fd2556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume volume-604acbe6-7b83-4ce1-bc58-56376fd407ff (604acbe6-7b83-4ce1-bc58-56376fd407ff): created successfully Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a44983-9d44-4094-a6e5-29e711fd2556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (5a5e4a88-1bd2-413e-9546-96ecbfb5d47e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2a160558-02e6-4bd3-9ca0-56783fd49094 tempest-VolumesSnapshotTestJSON-2133879486 None] Created volume successfully. Sep 17 15:09:19 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 1073741824" returned: 0 in 0.929s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:19 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 Sep 17 15:09:19 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:19 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" returned: 0 in 0.439s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.201s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadbbbb9-8c38-467f-ba82-a8a5d488c8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5efae14-b18a-43e5-a816-ffc544f8b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Creating offline snapshot 2f020526-3f8c-4e90-9b82-e9fdf6eb941b of volume 604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:09:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Volume volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 (2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01): created successfully Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5efae14-b18a-43e5-a816-ffc544f8b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (9386e25f-f36b-4095-8272-b8b9f5983bce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19240da7-0ee0-4c1d-a90d-6775fef69a3b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9b176395-14dd-4ac4-b6a7-9f43004f096e tempest-VolumesListTestJSON-974794719 None] Created volume successfully. Sep 17 15:09:20 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:20 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:20 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.458s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:20 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b 1G Sep 17 15:09:20 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:21 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b 1G" returned: 0 in 0.606s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604acbe6-7b83-4ce1-bc58-56376fd407ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:21 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604acbe6-7b83-4ce1-bc58-56376fd407ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:21 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:21 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-604acbe6-7b83-4ce1-bc58-56376fd407ff -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.423s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:21 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b is being set with open permissions: ugo+rw Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:21 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:21 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (a7ca948b-ac15-4650-b2e5-7854685a5fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ad29fd-c79a-4adb-bf1f-6b40ac99d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ad29fd-c79a-4adb-bf1f-6b40ac99d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844987888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19388e1-6581-48a4-a2b6-df392ab7aeb4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:22Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99cc220-5659-4930-9a3b-5a93dfbae6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b99cc220-5659-4930-9a3b-5a93dfbae6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e79752-0283-4168-a31d-870b26cdcf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e79752-0283-4168-a31d-870b26cdcf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b19388e1-6581-48a4-a2b6-df392ab7aeb4', 'volume_name': 'volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad67793-bf8a-48b0-b0d4-b77d475d4afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad67793-bf8a-48b0-b0d4-b77d475d4afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fc2694-3dcd-4744-aa68-1a20e939ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Volume b19388e1-6581-48a4-a2b6-df392ab7aeb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4', 'volume_size': 1} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:21 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:21 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info Sep 17 15:09:21 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:22 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info is being set with open permissions: ugo+rw Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:22 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info Sep 17 15:09:22 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-c4b1f26e-6f4e-4ae6-b156-0498b78e6376-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "cinder-c4b1f26e-6f4e-4ae6-b156-0498b78e6376-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82f3744-b387-4950-b39d-6c0990779193]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:22 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.info" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:22 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 Sep 17 15:09:22 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1844987888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b19388e1-6581-48a4-a2b6-df392ab7aeb4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:22Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Creating volume b19388e1-6581-48a4-a2b6-df392ab7aeb4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:22 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:22 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 1073741824 Sep 17 15:09:22 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb1daf81-eea1-4477-9a8e-9707c8bf731a tempest-VolumesSnapshotTestJSON-2133879486 None] Create snapshot completed successfully Sep 17 15:09:23 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" returned: 0 in 0.673s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:23 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376 Sep 17 15:09:23 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:23 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 1073741824" returned: 0 in 0.985s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:23 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" returned: 0 in 0.612s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-c4b1f26e-6f4e-4ae6-b156-0498b78e6376" released by "delete_volume" :: held 1.374s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:23 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 Sep 17 15:09:23 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:23 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Created reservations ['96993bed-3c5d-4af9-a54a-7152e9b480cf', 'cb503f1a-5eac-4ba6-b7d3-811b876d5fb7', '6c710237-0f41-4c2d-852e-b10cb42c7cd0', 'bd6b634c-bc8e-4955-b15c-9138658f4ba3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:24 devstack sudo[97816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:24 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:24 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (ee75ce8d-869f-4092-947d-19293e886669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a59a70-2014-4c3e-9b40-421b36b74087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4" returned: 0 in 0.631s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] <== create_volume: return (1788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a59a70-2014-4c3e-9b40-421b36b74087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-826309884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a070891e-e095-407a-8cda-efd3ec3c4f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2f020526-3f8c-4e90-9b82-e9fdf6eb941b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:24Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26fc9b4-5abc-4a40-a005-ceecb5e27235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26fc9b4-5abc-4a40-a005-ceecb5e27235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c795b4-30e9-4d5c-a472-350990920dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c795b4-30e9-4d5c-a472-350990920dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a070891e-e095-407a-8cda-efd3ec3c4f8a', 'volume_name': 'volume-a070891e-e095-407a-8cda-efd3ec3c4f8a', 'volume_size': 2, 'snapshot_id': '2f020526-3f8c-4e90-9b82-e9fdf6eb941b'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8140c5-4350-4805-92d8-ffb0bf81f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8140c5-4350-4805-92d8-ffb0bf81f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca1cbc-00e2-428d-a5fc-b13c437e8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume a070891e-e095-407a-8cda-efd3ec3c4f8a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a070891e-e095-407a-8cda-efd3ec3c4f8a', 'volume_size': 2, 'snapshot_id': '2f020526-3f8c-4e90-9b82-e9fdf6eb941b'} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fc2694-3dcd-4744-aa68-1a20e939ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f56728-8e21-4e6f-896d-cdcc2e7b0f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-a070891e-e095-407a-8cda-efd3ec3c4f8a" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Volume volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 (b19388e1-6581-48a4-a2b6-df392ab7aeb4): created successfully Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f56728-8e21-4e6f-896d-cdcc2e7b0f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (a7ca948b-ac15-4650-b2e5-7854685a5fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-a070891e-e095-407a-8cda-efd3ec3c4f8a" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating volume a070891e-e095-407a-8cda-efd3ec3c4f8a from snapshot 2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f3b48417-805e-4ad5-ab3e-a692cd049fc8 tempest-VolumesListTestJSON-974794719 None] Created volume successfully. Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] snapshot: 2f020526-3f8c-4e90-9b82-e9fdf6eb941b, volume: a070891e-e095-407a-8cda-efd3ec3c4f8a, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:09:24 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.418s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Deleted volume successfully. Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3bf9bc-085f-459c-a87d-1275de9fcf61]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca2fcafa-a5c1-43a5-9a14-5abf9159a1bb tempest-TestStampPattern-1047644296 None] Lock "cinder-c4b1f26e-6f4e-4ae6-b156-0498b78e6376-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:24 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:24 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Deleting offline snapshot ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b of volume 9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] snapshot_file for this snap is: volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f7884-fe60-4f37-b6cf-5621defb1e03]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:25 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.679s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604acbe6-7b83-4ce1-bc58-56376fd407ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69678035-4d9b-49ed-9505-9d26379c21ef]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:25 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:09:25 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:25 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:25 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:25 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.551s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9646f383-7448-4025-9fe4-6c90c71f1e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:25 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (87d832cb-90ec-4700-8625-6e3d308da6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af13367-f888-4737-bc50-0a25f0451ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd2e58-6faf-4438-9d29-06caa68ca4da]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.611s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af13367-f888-4737-bc50-0a25f0451ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228520830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0d4614-abda-4f69-af4c-d76c4dd6939b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:26Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82239379-c179-46d0-9082-ae824b8f2078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82239379-c179-46d0-9082-ae824b8f2078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:26 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3012ce1e-a9d0-4688-8182-d06c170262a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:26 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3012ce1e-a9d0-4688-8182-d06c170262a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0d4614-abda-4f69-af4c-d76c4dd6939b', 'volume_name': 'volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df892f2-b403-4ccf-90e8-94a04e8aa4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7df892f2-b403-4ccf-90e8-94a04e8aa4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f481783-48df-43cd-8ae1-2cea6583a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Volume 7e0d4614-abda-4f69-af4c-d76c4dd6939b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b', 'volume_size': 1} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:26 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:09:26 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:26 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.741s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:26 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:09:26 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:27 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.970s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:27 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b Sep 17 15:09:27 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:28 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44.ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" returned: 0 in 0.810s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b" released by "_delete_snapshot" :: held 3.392s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" released by "delete_snapshot" :: held 3.448s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Created reservations ['81b61284-f68d-4122-8ffc-e3c5e04cdbf8', 'cb906c89-3e31-4dd5-87de-253c6d93bea3', '4d71d908-091b-4c40-bba6-94be6e50da46', 'f5efd2cc-b3c9-4fa8-b40b-c86d7a7e5545'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Delete snapshot completed successfully. Sep 17 15:09:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ce2cc2f5-446a-4d26-a9cd-cc570e05e635 tempest-TestStampPattern-1047644296 None] Lock "cinder-ffdc3a96-5cbd-4ac6-8b97-cd74210f5c8b-delete_snapshot" released by "delete_snapshot" :: held 3.826s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:36 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a" returned: 0 in 10.845s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:36 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff, size 1024.00 MB, duration 10.85 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:09:36 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Converted 1024.00 MB image at 94.41 MB/s Sep 17 15:09:36 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a is being set with open permissions: ugo+rw Sep 17 15:09:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:36 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a Sep 17 15:09:36 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:37 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" released by "_copy_volume_from_snapshot" :: held 12.521s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-a070891e-e095-407a-8cda-efd3ec3c4f8a" released by "_create_volume_from_snapshot" :: held 12.630s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.682s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.078s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228520830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0d4614-abda-4f69-af4c-d76c4dd6939b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c47830c88a3d4effb2654835660da39e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:26Z,use_quota=True,user_id='8b9f6098a36e46f1bb489243ae85cb24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Creating volume 7e0d4614-abda-4f69-af4c-d76c4dd6939b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:37 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b 1073741824 Sep 17 15:09:37 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ca1cbc-00e2-428d-a5fc-b13c437e8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a070891e-e095-407a-8cda-efd3ec3c4f8a', 'volume_size': 2, 'snapshot_id': '2f020526-3f8c-4e90-9b82-e9fdf6eb941b'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a72b80-9ca2-42ca-969c-de01f31aa43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:37 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume volume-a070891e-e095-407a-8cda-efd3ec3c4f8a (a070891e-e095-407a-8cda-efd3ec3c4f8a): created successfully Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a72b80-9ca2-42ca-969c-de01f31aa43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (ee75ce8d-869f-4092-947d-19293e886669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2fe2e6fd-cebb-4742-ae50-482f75ff41d4 tempest-VolumesSnapshotTestJSON-2133879486 None] Created volume successfully. Sep 17 15:09:37 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-9646f383-7448-4025-9fe4-6c90c71f1e44-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b 1073741824" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "cinder-9646f383-7448-4025-9fe4-6c90c71f1e44-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Acquiring lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:37 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b Sep 17 15:09:37 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86295720-6238-4ccc-88a1-6577705a8b60]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-a070891e-e095-407a-8cda-efd3ec3c4f8a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-a070891e-e095-407a-8cda-efd3ec3c4f8a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:38 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:09:38 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d916cb9d-8163-4e24-bc88-4ab19962ed57]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:38 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f481783-48df-43cd-8ae1-2cea6583a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711c72e3-c4f6-4297-9fd2-ce86e530bca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Volume volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b (7e0d4614-abda-4f69-af4c-d76c4dd6939b): created successfully Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711c72e3-c4f6-4297-9fd2-ce86e530bca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Flow 'volume_create_manager' (87d832cb-90ec-4700-8625-6e3d308da6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ddbc408e-86cf-4f1c-94e4-c739271d2976 tempest-VolumesListTestJSON-974794719 None] Created volume successfully. Sep 17 15:09:38 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a Sep 17 15:09:38 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:38 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:38 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44 Sep 17 15:09:38 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:38 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:38 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a Sep 17 15:09:38 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:38 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9646f383-7448-4025-9fe4-6c90c71f1e44" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "cinder-quobyte-9646f383-7448-4025-9fe4-6c90c71f1e44" released by "delete_volume" :: held 0.757s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Created reservations ['f5e9e977-5bb8-439a-9e49-bbe013b5d9b5', '43ed80b2-ce4f-4c3d-904b-b526abbf8cb6', 'd785295d-3b37-48cb-aca0-f3eeee7444a0', '0af6e94f-b11b-4701-b838-0b5d73dcd138'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:38 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a070891e-e095-407a-8cda-efd3ec3c4f8a" returned: 0 in 0.313s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-a070891e-e095-407a-8cda-efd3ec3c4f8a" released by "delete_volume" :: held 0.751s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:38 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:38 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['eeb34c94-c5f3-46d7-8049-8be3a4e9c7de', '6fe40cea-ae34-45be-a1b5-ea4e641b0b55', '1bf47c6a-dcd0-4938-86a7-64970e58b4a6', 'f1c8b79e-e5a7-48f7-8aa0-c3d0adcf0b25'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:39 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:39 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:39 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Deleting offline snapshot 2f020526-3f8c-4e90-9b82-e9fdf6eb941b of volume 604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] snapshot_file for this snap is: volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:09:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Deleted volume successfully. Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e1adf8-4f2f-443f-aa72-93603109b247]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:39 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-14febd06-66a3-451b-b9fd-b3450b5c7326 tempest-TestStampPattern-1047644296 None] Lock "cinder-9646f383-7448-4025-9fe4-6c90c71f1e44-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Deleted volume successfully. Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-60cdcac6-14b5-48dc-8b37-b0a9fc9d906b tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-a070891e-e095-407a-8cda-efd3ec3c4f8a-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:39 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:39 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:39 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-604acbe6-7b83-4ce1-bc58-56376fd407ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d132cef1-0ff9-4681-b79d-56c015601beb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:40 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:40 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:40 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.908s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:40 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:40 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:41 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:41 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b Sep 17 15:09:41 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:41 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff.2f020526-3f8c-4e90-9b82-e9fdf6eb941b" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-7e0d4614-abda-4f69-af4c-d76c4dd6939b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-2f020526-3f8c-4e90-9b82-e9fdf6eb941b" released by "_delete_snapshot" :: held 2.346s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" released by "delete_snapshot" :: held 2.396s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-7e0d4614-abda-4f69-af4c-d76c4dd6939b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-quobyte-7e0d4614-abda-4f69-af4c-d76c4dd6939b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-7e0d4614-abda-4f69-af4c-d76c4dd6939b" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['f2997e94-e5ba-4c62-bc78-7a560b5e24d1', '345268b5-db95-46b4-804b-7c13c30aa0f3', 'f961ce93-d476-4c33-b89d-bdaf274e0592', 'e34e5396-b98c-41f8-abaf-a8706dbb5833'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec4c1d0-aca0-42d9-9c1c-25372dfd6809]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Delete snapshot completed successfully. Sep 17 15:09:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c4cf6459-1c2f-4776-a237-5498007a9ea0 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-2f020526-3f8c-4e90-9b82-e9fdf6eb941b-delete_snapshot" released by "delete_snapshot" :: held 2.637s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:42 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b Sep 17 15:09:42 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:42 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:42 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b Sep 17 15:09:42 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:42 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e0d4614-abda-4f69-af4c-d76c4dd6939b" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-7e0d4614-abda-4f69-af4c-d76c4dd6939b" released by "delete_volume" :: held 0.730s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Created reservations ['238ccbb9-2867-401d-a12d-8239b14f1d8a', 'd9ddaa7b-a011-4568-baca-99eb504420dc', '2a7e727b-2526-47cb-8bed-2b842af1df17', '16113267-67a4-4ec2-b485-f0577256d66d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-604acbe6-7b83-4ce1-bc58-56376fd407ff-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-604acbe6-7b83-4ce1-bc58-56376fd407ff-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:42 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:42 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b415e806-838c-45d7-b161-43ff1fcf3a29]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:42 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:42 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-b19388e1-6581-48a4-a2b6-df392ab7aeb4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-b19388e1-6581-48a4-a2b6-df392ab7aeb4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:42 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:42 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Deleted volume successfully. Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-quobyte-b19388e1-6581-48a4-a2b6-df392ab7aeb4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-823264b1-5e71-4abf-8892-49a55c75ff5e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-7e0d4614-abda-4f69-af4c-d76c4dd6939b-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-b19388e1-6581-48a4-a2b6-df392ab7aeb4" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6ec0c1-33a3-4f83-aafa-45c13a3984fd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:43 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 Sep 17 15:09:43 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:43 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:43 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff Sep 17 15:09:43 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:43 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:43 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4 Sep 17 15:09:43 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:43 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-604acbe6-7b83-4ce1-bc58-56376fd407ff" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-604acbe6-7b83-4ce1-bc58-56376fd407ff" released by "delete_volume" :: held 0.896s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['09370a7c-ae50-4327-b33e-cd197804a602', 'ec028e18-a9fb-4d5e-a67c-7972cd040e59', '95ef93bb-4010-4517-aa6e-d894d17e1150', 'a6dc1423-a98e-460f-96c4-8b4ef6b5c3fe'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:43 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:43 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:43 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b19388e1-6581-48a4-a2b6-df392ab7aeb4" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-b19388e1-6581-48a4-a2b6-df392ab7aeb4" released by "delete_volume" :: held 0.842s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:43 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Created reservations ['10a506e2-afd2-406c-a49c-5a9dc13fadec', '59f3ac87-2b5a-4461-ab41-06348e6f77ef', '9fd906b5-fc62-4510-b8cd-14c1b0ecbdce', 'dcfc3ea2-bd24-42fc-b82a-ce3c1447900c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:44 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:44 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:44 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Deleted volume successfully. Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "cinder-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-111b9a0e-1846-42a5-8195-3c1828735e78 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-604acbe6-7b83-4ce1-bc58-56376fd407ff-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "cinder-quobyte-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc26ce-e42b-4ef2-bbf5-18ea20516725]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:44 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Deleted volume successfully. Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e2df3014-e3ff-4ad9-8997-f2fe9929b04e tempest-VolumesListTestJSON-974794719 None] Lock "cinder-b19388e1-6581-48a4-a2b6-df392ab7aeb4-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:44 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 Sep 17 15:09:44 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (12550373-2f1f-4ea8-bfc2-1670b20b0ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89e2784-a3fc-407f-8e61-a6fbaeb4ee5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e89e2784-a3fc-407f-8e61-a6fbaeb4ee5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564378433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe5ae92-e7ca-4349-a103-29cb6851f5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:45Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d280496-9809-4400-9818-d3849c6e2bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d280496-9809-4400-9818-d3849c6e2bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae406f4-8bed-4f8d-af88-de140071b4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae406f4-8bed-4f8d-af88-de140071b4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe5ae92-e7ca-4349-a103-29cb6851f5ba', 'volume_name': 'volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30ca9c7-6739-49f7-a61f-020525a5a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e30ca9c7-6739-49f7-a61f-020525a5a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33508725-fbb4-43b2-88f8-93f0e7c11698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Volume ffe5ae92-e7ca-4349-a103-29cb6851f5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba', 'volume_size': 1} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-564378433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe5ae92-e7ca-4349-a103-29cb6851f5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:45Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Creating volume ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:44 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:44 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba 1073741824 Sep 17 15:09:44 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:45 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" returned: 0 in 0.653s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:45 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01 Sep 17 15:09:45 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:45 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "cinder-quobyte-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01" released by "delete_volume" :: held 1.076s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:45 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba 1073741824" returned: 0 in 0.604s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Created reservations ['004d0893-63f6-485e-b857-7fb9c67a2b07', '62370034-3346-4c37-b774-30c68ff8d584', '208bbf34-8616-4876-9a78-5a2786ed54c5', 'ae109785-70e2-4b71-a8a5-555e43a6e8e9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:45 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:09:45 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:45 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:45 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:45 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33508725-fbb4-43b2-88f8-93f0e7c11698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a4a29-8510-4f67-9643-d9b3df41b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Volume volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba (ffe5ae92-e7ca-4349-a103-29cb6851f5ba): created successfully Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145a4a29-8510-4f67-9643-d9b3df41b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (12550373-2f1f-4ea8-bfc2-1670b20b0ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fd9216a4-730d-4686-bee8-fade0d4691fd tempest-VolumesSnapshotTestJSON-2133879486 None] Created volume successfully. Sep 17 15:09:45 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:45 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Deleted volume successfully. Sep 17 15:09:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-171806f0-cf35-4b74-b868-7277b26b9325 tempest-VolumesListTestJSON-974794719 None] Lock "cinder-2caaa67e-e9e3-4a14-8bcc-1532ac5a8c01-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating offline snapshot eec0ee48-9269-420c-a75e-0696ac892ed9 of volume ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[acab07b5-8b30-43ef-a5a6-57e2cf8db3f8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:47 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:09:47 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:47 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:47 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 1G Sep 17 15:09:47 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:48 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 1G" returned: 0 in 0.533s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:48 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:09:48 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:48 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 is being set with open permissions: ugo+rw Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:48 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:09:48 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:48 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:48 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=115,cinder:INSERT=31,cinder:UPDATE=130,cinder:DELETE=7 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:09:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:49 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info Sep 17 15:09:49 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:49 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:49 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info is being set with open permissions: ugo+rw Sep 17 15:09:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:49 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info Sep 17 15:09:49 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:49 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.info" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e8b48529-c7b7-44c1-a02f-ecccd1be6055 tempest-VolumesSnapshotTestJSON-2133879486 None] Create snapshot completed successfully Sep 17 15:09:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c5310ee1-86f3-44ec-9480-3b9e3e7eec6b req-7440f296-9e20-4a54-8c11-659d64b4150d tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c5310ee1-86f3-44ec-9480-3b9e3e7eec6b req-7440f296-9e20-4a54-8c11-659d64b4150d tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c5310ee1-86f3-44ec-9480-3b9e3e7eec6b req-7440f296-9e20-4a54-8c11-659d64b4150d tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c5310ee1-86f3-44ec-9480-3b9e3e7eec6b req-7440f296-9e20-4a54-8c11-659d64b4150d tempest-TestServerVolumeAttachmentScenario-169582370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-842178f8-08f8-49d4-bbad-dde89dfbf263', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee7fc8df-9ca2-4050-bff0-f32701b83e40', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:09:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c5310ee1-86f3-44ec-9480-3b9e3e7eec6b req-7440f296-9e20-4a54-8c11-659d64b4150d tempest-TestServerVolumeAttachmentScenario-169582370 None] attachment_update completed successfully. Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Flow 'volume_create_manager' (7308af15-1014-42d7-ad2c-848498e3fe98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c12cf9-94a4-4e57-bcd3-b2b1cfabfa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25c12cf9-94a4-4e57-bcd3-b2b1cfabfa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-599640426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dda153-9edc-440b-a9ab-cadff6ebb7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb144096d3c40da8f1dbe0ccf52af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:51Z,use_quota=True,user_id='cbacb1ad30cf4a3c8e731a0da5f202a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a475a32-fb31-4e50-84c8-71b0ba2e3b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a475a32-fb31-4e50-84c8-71b0ba2e3b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bd8eb1-355e-4c76-b13f-56d2ccef57a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bd8eb1-355e-4c76-b13f-56d2ccef57a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dda153-9edc-440b-a9ab-cadff6ebb7fb', 'volume_name': 'volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3eaa60-23db-4304-8036-dd21ea3c9aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3eaa60-23db-4304-8036-dd21ea3c9aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9a2af3-ec69-4fb1-abcf-5e0d3d1af4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb', 'volume_size': 1} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-599640426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dda153-9edc-440b-a9ab-cadff6ebb7fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffb144096d3c40da8f1dbe0ccf52af48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:51Z,use_quota=True,user_id='cbacb1ad30cf4a3c8e731a0da5f202a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Creating volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:51 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb 1073741824 Sep 17 15:09:51 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (5d2e6c8c-413b-44ca-b863-750f36c43eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af964c3-1ad3-4b93-9cff-65e7ea982a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af964c3-1ad3-4b93-9cff-65e7ea982a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1915224598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b354fcfd-d42f-42ac-9f54-495143c74928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9727024f577842a1a091088e8d8b38d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eec0ee48-9269-420c-a75e-0696ac892ed9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:52Z,use_quota=True,user_id='9e086bb94d1d4a4389f6c01cf1df01ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6bf346-13fb-4406-8153-c4839e1022b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6bf346-13fb-4406-8153-c4839e1022b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00e3bb7-1ec0-42f4-a890-1f38b04fe6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00e3bb7-1ec0-42f4-a890-1f38b04fe6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b354fcfd-d42f-42ac-9f54-495143c74928', 'volume_name': 'volume-b354fcfd-d42f-42ac-9f54-495143c74928', 'volume_size': 1, 'snapshot_id': 'eec0ee48-9269-420c-a75e-0696ac892ed9'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8821cb6-d34e-4797-a108-f2d295e6e3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8821cb6-d34e-4797-a108-f2d295e6e3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f838a-badf-4e79-a93b-1bb7f757f231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume b354fcfd-d42f-42ac-9f54-495143c74928: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b354fcfd-d42f-42ac-9f54-495143c74928', 'volume_size': 1, 'snapshot_id': 'eec0ee48-9269-420c-a75e-0696ac892ed9'} Sep 17 15:09:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:52 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb 1073741824" returned: 0 in 0.526s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:52 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb Sep 17 15:09:52 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:52 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" returned: 0 in 0.269s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.653s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9-b354fcfd-d42f-42ac-9f54-495143c74928" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be9a2af3-ec69-4fb1-abcf-5e0d3d1af4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257577ec-426b-45de-a51d-f8171ec2e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9-b354fcfd-d42f-42ac-9f54-495143c74928" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating volume b354fcfd-d42f-42ac-9f54-495143c74928 from snapshot eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:09:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Volume volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb (a7dda153-9edc-440b-a9ab-cadff6ebb7fb): created successfully Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257577ec-426b-45de-a51d-f8171ec2e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Flow 'volume_create_manager' (7308af15-1014-42d7-ad2c-848498e3fe98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] snapshot: eec0ee48-9269-420c-a75e-0696ac892ed9, volume: b354fcfd-d42f-42ac-9f54-495143c74928, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e1923091-f0a1-42d5-bc8b-6d69820f8852 tempest-VolumesSnapshotListTestJSON-1387269814 None] Created volume successfully. Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a8ebbe-0837-49cb-8046-22fcdd4abd04]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:52 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:09:52 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:53 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca1a009-05e8-47d2-99d8-c14495bf1af9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:53 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:09:53 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:53 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:53 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 Sep 17 15:09:53 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (05caeeff-78e5-4327-b3c6-d46693af5612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353f8414-12a8-4f7e-95b1-6041951e83bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353f8414-12a8-4f7e-95b1-6041951e83bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312754896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5ceda8-78d9-4ac4-8660-304cc731ae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:55Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bf30b9-d2e5-43ef-8193-a359001bd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8bf30b9-d2e5-43ef-8193-a359001bd591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fbab88-4cab-4f2c-b324-da424b071e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18fbab88-4cab-4f2c-b324-da424b071e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5ceda8-78d9-4ac4-8660-304cc731ae04', 'volume_name': 'volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5cfdf8-4778-491f-81f5-e523de6495a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5cfdf8-4778-491f-81f5-e523de6495a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691b16f3-db46-4503-bba7-fc8eafe96656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:09:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume 6c5ceda8-78d9-4ac4-8660-304cc731ae04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04', 'volume_size': 1} Sep 17 15:09:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:09:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:09:57 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:09:57 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:09:57 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:09:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e948068f-d3d5-4995-9f35-cc88caa7d123 req-3039a6a3-0bbe-4333-a628-fc833b36ad30 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:00 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928" returned: 0 in 7.231s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:10:00 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Converted 1024.00 MB image at 141.59 MB/s Sep 17 15:10:00 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 is being set with open permissions: ugo+rw Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:00 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 Sep 17 15:10:00 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:00 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" released by "_copy_volume_from_snapshot" :: held 8.375s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9-b354fcfd-d42f-42ac-9f54-495143c74928" released by "_create_volume_from_snapshot" :: held 8.486s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.540s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.038s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Creating offline snapshot f0c89381-f587-4127-a547-66ddc8838149 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40f838a-badf-4e79-a93b-1bb7f757f231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b354fcfd-d42f-42ac-9f54-495143c74928', 'volume_size': 1, 'snapshot_id': 'eec0ee48-9269-420c-a75e-0696ac892ed9'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba2a3b0-622d-4294-bcce-525fda243885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cb858c-082c-42bf-a32c-098e08317814]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Volume volume-b354fcfd-d42f-42ac-9f54-495143c74928 (b354fcfd-d42f-42ac-9f54-495143c74928): created successfully Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba2a3b0-622d-4294-bcce-525fda243885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Flow 'volume_create_manager' (5d2e6c8c-413b-44ca-b863-750f36c43eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4c9c7827-e21d-4227-bde8-bd1b2772f1e4 tempest-VolumesSnapshotTestJSON-2133879486 None] Created volume successfully. Sep 17 15:10:01 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb Sep 17 15:10:01 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:01 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:01 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 1G Sep 17 15:10:01 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:01 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 1G" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-b354fcfd-d42f-42ac-9f54-495143c74928-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:01 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:01 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-b354fcfd-d42f-42ac-9f54-495143c74928-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d45a6a-f56c-44bd-9072-e161ec512db8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 Sep 17 15:10:02 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 is being set with open permissions: ugo+rw Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:02 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928 Sep 17 15:10:02 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info Sep 17 15:10:02 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b354fcfd-d42f-42ac-9f54-495143c74928" returned: 0 in 0.260s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-b354fcfd-d42f-42ac-9f54-495143c74928" released by "delete_volume" :: held 0.678s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['df07d376-95a7-4f6f-b6f7-cb0c516e5882', '9a5aa633-5f90-47fe-a4aa-0649669008d4', 'b2442ab1-836b-4586-8c9a-57369d0b2756', '41b0d867-25d8-4eca-a831-6d1f3ed35613'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:02 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info" returned: 0 in 0.286s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info is being set with open permissions: ugo+rw Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:02 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:02 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:02 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:02 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.info" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.693s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-312754896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5ceda8-78d9-4ac4-8660-304cc731ae04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:09:55Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume 6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:03 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-eec0ee48-9269-420c-a75e-0696ac892ed9-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:03 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 1073741824 Sep 17 15:10:03 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-eec0ee48-9269-420c-a75e-0696ac892ed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Deleted volume successfully. Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2c51a2b-60e4-4c2f-b5a9-ce6b124c32fb tempest-VolumesSnapshotListTestJSON-1387269814 None] Create snapshot completed successfully Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9b59195e-f39b-4654-90eb-3af358d0ceeb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-b354fcfd-d42f-42ac-9f54-495143c74928-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Deleting offline snapshot eec0ee48-9269-420c-a75e-0696ac892ed9 of volume ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] snapshot_file for this snap is: volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb73bff8-cbec-4f1e-8686-77eb86443c39]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:03 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:10:03 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:03 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 1073741824" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:03 devstack sudo[98629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 Sep 17 15:10:03 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:03 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cb7ec5-6ac2-418b-a2db-6d8c745121b3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:03 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:10:03 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:03 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e948068f-d3d5-4995-9f35-cc88caa7d123 req-3039a6a3-0bbe-4333-a628-fc833b36ad30 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e948068f-d3d5-4995-9f35-cc88caa7d123 req-3039a6a3-0bbe-4333-a628-fc833b36ad30 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691b16f3-db46-4503-bba7-fc8eafe96656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60763d-2cab-40cb-9c70-ec5677a14914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 (6c5ceda8-78d9-4ac4-8660-304cc731ae04): created successfully Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba60763d-2cab-40cb-9c70-ec5677a14914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (05caeeff-78e5-4327-b3c6-d46693af5612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e948068f-d3d5-4995-9f35-cc88caa7d123 req-3039a6a3-0bbe-4333-a628-fc833b36ad30 tempest-TestServerVolumeAttachmentScenario-169582370 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-14a70d84-90d2-4a7d-9d6d-1025eed65386', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14ceb69e-43bc-4fa4-80dc-28cff57855e0', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-918b82fc-9694-4f43-8600-3fa719f452f5 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e948068f-d3d5-4995-9f35-cc88caa7d123 req-3039a6a3-0bbe-4333-a628-fc833b36ad30 tempest-TestServerVolumeAttachmentScenario-169582370 None] attachment_update completed successfully. Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Creating offline snapshot 6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:04 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.679s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acdcab3-45de-427c-8b3d-491c3c140a7e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:04 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:10:04 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:04 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:04 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:04 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:04 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9 Sep 17 15:10:04 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:04 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:04 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 1G Sep 17 15:10:04 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:04 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba.eec0ee48-9269-420c-a75e-0696ac892ed9" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-eec0ee48-9269-420c-a75e-0696ac892ed9" released by "_delete_snapshot" :: held 1.877s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" released by "delete_snapshot" :: held 1.906s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['ddec5b95-af08-4723-b79e-75dd5e0317f5', '2de7ee43-48de-4cf8-8118-0febe369eaca', '58a57c73-da23-42d7-8c72-97be5f116a75', 'a9118b2c-3858-454b-bf84-d6f30c47f49f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Delete snapshot completed successfully. Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b69430be-6d0f-4879-bf25-0e54de1fffdb tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-eec0ee48-9269-420c-a75e-0696ac892ed9-delete_snapshot" released by "delete_snapshot" :: held 2.159s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:05 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 1G" returned: 0 in 0.578s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:05 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:05 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:05 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:05 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 is being set with open permissions: ugo+rw Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:05 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:05 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-199037d4-ef77-43e2-934e-97e981ab6d04 req-87341f01-505b-408c-9c6c-126613ee82e5 tempest-TestServerVolumeAttachmentScenario-169582370 None] Terminate volume connection completed successfully. Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-199037d4-ef77-43e2-934e-97e981ab6d04 req-87341f01-505b-408c-9c6c-126613ee82e5 tempest-TestServerVolumeAttachmentScenario-169582370 None] Deleting attachment 14ceb69e-43bc-4fa4-80dc-28cff57855e0. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:10:05 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.704s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.762s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating offline snapshot 5358de0b-a00d-4f55-9af1-6ce65040ee97 of volume 6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8341c60b-ab6c-4127-96c2-e1ee89c28e63 tempest-VolumesSnapshotListTestJSON-1387269814 None] Create snapshot completed successfully Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0422765-fead-49b8-b4a8-266609771446]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 Sep 17 15:10:06 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-ffe5ae92-e7ca-4349-a103-29cb6851f5ba-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:06 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-ffe5ae92-e7ca-4349-a103-29cb6851f5ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:06 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 1G Sep 17 15:10:06 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=151,cinder:SELECT=144,cinder:DELETE=18,cinder:INSERT=38 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ef4f63-b7a4-44e7-b45e-0ec252fd3d9c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:06 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:10:06 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:06 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 1G" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 Sep 17 15:10:06 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:06 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:06 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba Sep 17 15:10:06 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:07 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:07 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 is being set with open permissions: ugo+rw Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:07 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:07 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 Sep 17 15:10:07 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-ffe5ae92-e7ca-4349-a103-29cb6851f5ba" released by "delete_volume" :: held 0.827s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['19db66d7-6425-49b3-bcc1-bf1f3f84d754', '7abf0de7-4ac7-4dfb-8eed-d28b17e95e11', '0eaa7351-4c69-407e-8830-7f903dc711d3', 'a4995081-9743-4cb7-ada4-a40b2ed35ccb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:07 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:07 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-67e1b3f9-cc43-4650-a6f9-b68c28cfcc66 req-cd8573f4-0d8c-4e52-8291-51234216cc7d tempest-TestServerVolumeAttachmentScenario-169582370 None] Terminate volume connection completed successfully. Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-67e1b3f9-cc43-4650-a6f9-b68c28cfcc66 req-cd8573f4-0d8c-4e52-8291-51234216cc7d tempest-TestServerVolumeAttachmentScenario-169582370 None] Deleting attachment ee7fc8df-9ca2-4050-bff0-f32701b83e40. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:10:07 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:07 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info Sep 17 15:10:07 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-c5b221c2-5ea4-42c1-8012-1b9be7d199c4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-c5b221c2-5ea4-42c1-8012-1b9be7d199c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:07 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Deleted volume successfully. Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9c7b2d18-469b-433f-8ef1-f539ae039120 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-ffe5ae92-e7ca-4349-a103-29cb6851f5ba-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f889dd-7035-471c-8f6b-f0a88cdd93b6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:07 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:07 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info is being set with open permissions: ugo+rw Sep 17 15:10:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:07 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info Sep 17 15:10:07 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:07 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 Sep 17 15:10:07 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:08 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.info" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.705s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Creating offline snapshot 9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:08 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1bfe86-3795-4368-b032-a442dd653a5c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:08 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4 Sep 17 15:10:08 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:08 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f87b800d-b93b-419c-ae3f-e606f2b1e291 tempest-CreateVolumesFromSnapshotTest-508439399 None] Create snapshot completed successfully Sep 17 15:10:08 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:08 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:08 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-quobyte-c5b221c2-5ea4-42c1-8012-1b9be7d199c4" released by "delete_volume" :: held 0.804s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Created reservations ['b78061b4-36d9-40a9-a84a-e14fe02455fa', 'b2095292-618a-4c5d-98c0-deed0c870371', '20ff16c6-b6d7-4e3f-a1c9-4d2f3dc90ec7', 'bcf52b10-73b7-40e1-8f5d-26309306ecd9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:08 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:08 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:08 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:08 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 1G Sep 17 15:10:08 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:09 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Deleted volume successfully. Sep 17 15:10:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d1cf60b7-91ad-43e0-ade9-6a3f0665b4d2 tempest-VolumesSnapshotTestJSON-2133879486 None] Lock "cinder-c5b221c2-5ea4-42c1-8012-1b9be7d199c4-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:09 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 1G" returned: 0 in 0.779s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:09 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 Sep 17 15:10:09 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (97984ba6-0bfc-4307-988b-59184c9577e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e2360e-b84e-4587-a368-09aeb5fdff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62e2360e-b84e-4587-a368-09aeb5fdff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46098113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045722b7-0cec-48e3-a347-9fddd61ad83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:10Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fffb8c-30bf-42f2-bfd0-d0ea8bb6c0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82fffb8c-30bf-42f2-bfd0-d0ea8bb6c0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2135a0-1128-4617-9b40-32802f513330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2135a0-1128-4617-9b40-32802f513330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045722b7-0cec-48e3-a347-9fddd61ad83d', 'volume_name': 'volume-045722b7-0cec-48e3-a347-9fddd61ad83d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93a95df-8e2a-4e75-8756-91e7abfdbfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e93a95df-8e2a-4e75-8756-91e7abfdbfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d4970d-2cb5-4c69-9c23-95269c46505c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume 045722b7-0cec-48e3-a347-9fddd61ad83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045722b7-0cec-48e3-a347-9fddd61ad83d', 'volume_size': 1} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:10 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:10 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 is being set with open permissions: ugo+rw Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:10 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 Sep 17 15:10:10 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (a34abc70-6c7e-47af-b465-0636059c77f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f51d78d-4f59-43e0-8246-cbe0c5be7d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f51d78d-4f59-43e0-8246-cbe0c5be7d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2143727379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:10Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14409266-8b69-4c7d-9a0f-2a81f0de0081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14409266-8b69-4c7d-9a0f-2a81f0de0081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5932bd26-316d-4d9e-9d4a-362fc48dc8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5932bd26-316d-4d9e-9d4a-362fc48dc8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7b95bfd-88aa-4874-9d34-8a0e44e0c7cd', 'volume_name': 'volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ba7309-7a0a-495e-99a8-d58d4ae5d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ba7309-7a0a-495e-99a8-d58d4ae5d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba33771-0c35-46c4-8391-ba510767a98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd', 'volume_size': 1} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.509s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46098113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045722b7-0cec-48e3-a347-9fddd61ad83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:10Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume 045722b7-0cec-48e3-a347-9fddd61ad83d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:10 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:10 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d 1073741824 Sep 17 15:10:10 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a0bf5461-4515-4acf-afce-bde9977a1915 tempest-VolumesSnapshotListTestJSON-1387269814 None] Create snapshot completed successfully Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (577c9961-8ac6-41b2-9617-2786e23e49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838df36a-7d1f-4ba2-998b-79fb8d0f4bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (838df36a-7d1f-4ba2-998b-79fb8d0f4bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852726001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54aa8a74-b26a-4a11-bb61-6f2ec6cb2911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:11Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7192eba-2513-4a9f-a42e-9c8a5ce4ae58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7192eba-2513-4a9f-a42e-9c8a5ce4ae58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaf63e5-329e-4649-996a-a95c9e5dea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eaf63e5-329e-4649-996a-a95c9e5dea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54aa8a74-b26a-4a11-bb61-6f2ec6cb2911', 'volume_name': 'volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882253da-a280-4087-b799-b3faaed2e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (882253da-a280-4087-b799-b3faaed2e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccca427-281f-4aea-bb26-429510cee00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume 54aa8a74-b26a-4a11-bb61-6f2ec6cb2911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911', 'volume_size': 1} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:11 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d 1073741824" returned: 0 in 1.017s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (a45641ec-35a5-4e79-b81b-b2d6e92fb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe13d802-d393-46b4-9165-45c548b97d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe13d802-d393-46b4-9165-45c548b97d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611858116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c52e702-5397-4b04-af21-c3fac1a68e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:12Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d Sep 17 15:10:11 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f251de-6885-47a1-b4a6-8deed8e96e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f251de-6885-47a1-b4a6-8deed8e96e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a2716d-c061-40c7-a525-3b190d833ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a2716d-c061-40c7-a525-3b190d833ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c52e702-5397-4b04-af21-c3fac1a68e07', 'volume_name': 'volume-6c52e702-5397-4b04-af21-c3fac1a68e07', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a22436-862f-4dfb-b43d-ff310c535bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a22436-862f-4dfb-b43d-ff310c535bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf343f2-a5e0-405e-bcd9-61eab8e67a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume 6c52e702-5397-4b04-af21-c3fac1a68e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c52e702-5397-4b04-af21-c3fac1a68e07', 'volume_size': 1} Sep 17 15:10:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:12 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d" returned: 0 in 0.502s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2143727379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:10Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:12 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd 1073741824 Sep 17 15:10:12 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d4970d-2cb5-4c69-9c23-95269c46505c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045722b7-0cec-48e3-a347-9fddd61ad83d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb53cc89-128f-420c-afbf-7f43209bc903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (e73e4943-c53b-42ff-a0fd-a57aed7b2481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea45add-7e54-4b42-ae90-672edac22d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-045722b7-0cec-48e3-a347-9fddd61ad83d (045722b7-0cec-48e3-a347-9fddd61ad83d): created successfully Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb53cc89-128f-420c-afbf-7f43209bc903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (97984ba6-0bfc-4307-988b-59184c9577e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea45add-7e54-4b42-ae90-672edac22d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199635607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336d1b6-0f4c-4c5f-a55f-b56469615d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:12Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cc170-a16a-4f27-9441-2a7a7b9bd26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23cc170-a16a-4f27-9441-2a7a7b9bd26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff919d6-6826-4d77-9c0b-6526f4b8b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aff919d6-6826-4d77-9c0b-6526f4b8b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7336d1b6-0f4c-4c5f-a55f-b56469615d9e', 'volume_name': 'volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3c5798-0c32-4eb3-be4b-67f7465b5a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd3c5798-0c32-4eb3-be4b-67f7465b5a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f72f8a0-2ed4-41b8-9427-28fbf5ef0001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume 7336d1b6-0f4c-4c5f-a55f-b56469615d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e', 'volume_size': 1} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-19e1b6ba-4852-4f2c-be1b-6dd66fd0e94a tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Deleting offline snapshot 9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] snapshot_file for this snap is: volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ce4627-d2b6-4bf5-adbb-7339f490a6ae]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:12 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:12 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 Sep 17 15:10:12 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd 1073741824" returned: 0 in 0.647s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd Sep 17 15:10:13 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94334db4-3e48-40b9-96ab-d826efc8efaa]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.176s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-852726001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54aa8a74-b26a-4a11-bb61-6f2ec6cb2911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:11Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume 54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba33771-0c35-46c4-8391-ba510767a98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a636021-8760-4298-bc26-bd3d49c6f9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:13 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 1073741824 Sep 17 15:10:13 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd (d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd): created successfully Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a636021-8760-4298-bc26-bd3d49c6f9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (a34abc70-6c7e-47af-b465-0636059c77f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-300d226c-b42d-4e6a-a74f-fce24f89f52f tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:13 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:13 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:13 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 Sep 17 15:10:13 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "cinder-14a70d84-90d2-4a7d-9d6d-1025eed65386-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-14a70d84-90d2-4a7d-9d6d-1025eed65386-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "cinder-quobyte-14a70d84-90d2-4a7d-9d6d-1025eed65386" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-quobyte-14a70d84-90d2-4a7d-9d6d-1025eed65386" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0469d0-dd05-43ec-b6de-d0bacfb6d93c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 1073741824" returned: 0 in 0.713s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 Sep 17 15:10:14 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 Sep 17 15:10:14 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012 Sep 17 15:10:14 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" returned: 0 in 0.275s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-611858116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c52e702-5397-4b04-af21-c3fac1a68e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:12Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume 6c52e702-5397-4b04-af21-c3fac1a68e07 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ccca427-281f-4aea-bb26-429510cee00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:14 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e172b80d-e134-4620-a6f8-4e26e90e5ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:14 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 1073741824 Sep 17 15:10:14 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 (54aa8a74-b26a-4a11-bb61-6f2ec6cb2911): created successfully Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e172b80d-e134-4620-a6f8-4e26e90e5ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (577c9961-8ac6-41b2-9617-2786e23e49d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:14 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386 Sep 17 15:10:14 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a48ff1ce-2a17-4068-a021-9bc20cf0ed65 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:14 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012" released by "_delete_snapshot" :: held 1.929s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" released by "delete_snapshot" :: held 1.962s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Created reservations ['54090d11-6a89-4138-8324-be9f6df669af', '1997336b-26e6-4032-b33f-f4894da29fda', '75bc5908-d003-44ca-a2c4-e9b27d664101', 'b5f91df8-072a-4b68-8f34-5508bcd168a2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Delete snapshot completed successfully. Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-72ec719f-48d9-491d-988b-410dedd3f540 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-9c3c1c6c-0b9e-4cee-bb20-57b3c2b83012-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-14a70d84-90d2-4a7d-9d6d-1025eed65386" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-quobyte-14a70d84-90d2-4a7d-9d6d-1025eed65386" released by "delete_volume" :: held 0.849s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Deleting offline snapshot 6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] snapshot_file for this snap is: volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Created reservations ['9bb989f3-8cc5-4da8-ae0b-9ac81453d515', '792089ff-9893-442b-adad-ed2103454962', '99ac7c09-a824-4b87-a43d-5409b7e8848f', '273daa7d-30c5-44fd-96d9-c2f271e433a2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da68c0f-462a-40dd-ab36-5556f0821db1]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 1073741824" returned: 0 in 0.712s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:15 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:15 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 Sep 17 15:10:15 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Deleted volume successfully. Sep 17 15:10:15 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a488e0d5-e61c-49af-a061-544f5f08da77 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-14a70d84-90d2-4a7d-9d6d-1025eed65386-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.975s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1199635607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7336d1b6-0f4c-4c5f-a55f-b56469615d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7308902e0c44298090be7b07757eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:12Z,use_quota=True,user_id='e069bbf8fd2b4bf9b1eb354d4f150afd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Creating volume 7336d1b6-0f4c-4c5f-a55f-b56469615d9e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:15 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e 1073741824 Sep 17 15:10:15 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:15 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf343f2-a5e0-405e-bcd9-61eab8e67a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c52e702-5397-4b04-af21-c3fac1a68e07', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e8f3a6-ab5b-4d00-b79a-b35e60ea94fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-6c52e702-5397-4b04-af21-c3fac1a68e07 (6c52e702-5397-4b04-af21-c3fac1a68e07): created successfully Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99e8f3a6-ab5b-4d00-b79a-b35e60ea94fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (a45641ec-35a5-4e79-b81b-b2d6e92fb634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a972c51-66d8-41ce-b481-b497316b1030]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8a0c4ff6-1926-48f2-8e68-50ccc537fd77 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:15 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:15 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:16 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e 1073741824" returned: 0 in 0.541s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:16 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.471s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:16 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:16 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:16 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e Sep 17 15:10:16 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "cinder-842178f8-08f8-49d4-bbad-dde89dfbf263-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-842178f8-08f8-49d4-bbad-dde89dfbf263-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "cinder-quobyte-842178f8-08f8-49d4-bbad-dde89dfbf263" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-quobyte-842178f8-08f8-49d4-bbad-dde89dfbf263" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c13820-c4e9-439c-9c4b-749a5e4429eb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:16 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f72f8a0-2ed4-41b8-9427-28fbf5ef0001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185dfab-08e7-4758-ba08-8862c78c5282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Volume volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e (7336d1b6-0f4c-4c5f-a55f-b56469615d9e): created successfully Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4185dfab-08e7-4758-ba08-8862c78c5282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:16 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 Sep 17 15:10:16 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Flow 'volume_create_manager' (e73e4943-c53b-42ff-a0fd-a57aed7b2481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-447c05a6-7620-46b3-83aa-e62b5672f7a7 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created volume successfully. Sep 17 15:10:16 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:16 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2 Sep 17 15:10:16 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-7336d1b6-0f4c-4c5f-a55f-b56469615d9e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-7336d1b6-0f4c-4c5f-a55f-b56469615d9e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:16 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263 Sep 17 15:10:17 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:17 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" acquired by "delete_volume" :: waited 0.076s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2" released by "_delete_snapshot" :: held 2.111s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" released by "delete_snapshot" :: held 2.179s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cac888-408e-4e08-8bc4-84b605b586ba]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Created reservations ['f6cce4da-507b-42cf-a881-6ba008cf7a5e', '49a38036-f788-4e9a-a4ae-bf29d3970ee1', '690b0c27-1b3e-4e0d-8c48-6fa6e87e6369', 'f1591cfd-cfa7-43a0-ad56-adb7725ae20b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:17 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e Sep 17 15:10:17 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-842178f8-08f8-49d4-bbad-dde89dfbf263" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Delete snapshot completed successfully. Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ac84719-c6d4-4c71-b80f-e2f3d0f4c3d4 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-6aa88b06-f7a4-4f1a-9e11-3000cfc1dfa2-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-quobyte-842178f8-08f8-49d4-bbad-dde89dfbf263" released by "delete_volume" :: held 0.998s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Created reservations ['4c865425-3541-4937-91b5-964410a99bbc', '0ed19f9a-fa02-460f-8b90-110b10e50520', 'e73c39f7-f200-49d4-8a35-da4582441398', '71359967-1f0b-4b3d-8a29-b8be751214f8'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:17 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:17 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e Sep 17 15:10:17 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:17 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Deleted volume successfully. Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3596c6fc-9779-4949-a830-9f9230b741d6 tempest-TestServerVolumeAttachmentScenario-169582370 None] Lock "cinder-842178f8-08f8-49d4-bbad-dde89dfbf263-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-7336d1b6-0f4c-4c5f-a55f-b56469615d9e" released by "delete_volume" :: held 0.767s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['cf29fa6d-cb90-49a0-a4fa-46d2369da5af', '36bdddf6-3b1c-42a3-9242-43186ca1d7d7', 'b9955a8b-a217-4dfe-93da-42140f8e5a30', 'e600b8e1-3b0c-460d-b34d-0d8886b51d0d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:18 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-6c52e702-5397-4b04-af21-c3fac1a68e07-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-6c52e702-5397-4b04-af21-c3fac1a68e07-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-6c52e702-5397-4b04-af21-c3fac1a68e07" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-f0c89381-f587-4127-a547-66ddc8838149-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c52e702-5397-4b04-af21-c3fac1a68e07" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-f0c89381-f587-4127-a547-66ddc8838149-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b1a889-a072-4878-9ac6-66b8c112013f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-f0c89381-f587-4127-a547-66ddc8838149" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-f0c89381-f587-4127-a547-66ddc8838149" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Deleting offline snapshot f0c89381-f587-4127-a547-66ddc8838149 of volume a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] snapshot_file for this snap is: volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a1cb77-0b12-419c-bd36-cce85a06a8cd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de3511ce-9b49-41db-9a9a-2acb1bfb3ae4 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-7336d1b6-0f4c-4c5f-a55f-b56469615d9e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:18 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 Sep 17 15:10:18 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:18 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:18 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:18 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07" returned: 0 in 0.488s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:18 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07 Sep 17 15:10:18 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:18 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.465s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b06b1-f8da-4096-9d99-e0d92472523e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb Sep 17 15:10:19 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c52e702-5397-4b04-af21-c3fac1a68e07" returned: 0 in 0.292s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c52e702-5397-4b04-af21-c3fac1a68e07" released by "delete_volume" :: held 0.849s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['44636f43-fdfa-4da7-a81f-f3243b6fde2a', '7875fe30-905b-4856-9d56-c3adbf5080e3', '747e2893-e35a-42f6-a99f-6377bb2b4cba', '268fa706-2836-49cd-9c95-b78cf0ffba2c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:19 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" returned: 0 in 0.463s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:19 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b08bfc-cb9d-4f06-ba73-e120a6ee73e6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-945ef16e-89f2-4074-b245-b648f317944c tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-6c52e702-5397-4b04-af21-c3fac1a68e07-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:19 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 Sep 17 15:10:19 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:19 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:19 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149 Sep 17 15:10:19 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:20 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:20 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911 Sep 17 15:10:20 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:20 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb.f0c89381-f587-4127-a547-66ddc8838149" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-f0c89381-f587-4127-a547-66ddc8838149" released by "_delete_snapshot" :: held 1.977s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" released by "delete_snapshot" :: held 2.025s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Created reservations ['5636b8fa-fed8-4d03-97a2-8836972c671d', '0540e58f-a276-4a7f-8b99-ff4ad85bf287', 'c132bf75-8ef3-42d7-bfac-16c137c5c3cf', 'b33b4fed-4e24-44a4-8185-6a47dbc4f6c4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:20 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" returned: 0 in 0.342s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911" released by "delete_volume" :: held 0.975s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Delete snapshot completed successfully. Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6b6cfa6-0346-4ffe-8f17-23ffe886b5d9 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-f0c89381-f587-4127-a547-66ddc8838149-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['54575987-af64-49ec-bde7-93456471f4b6', '59377b09-b7f6-48e9-b0fc-e4b775c88b51', '0374c1b2-b8fc-492c-83e0-4f6629f8685b', '26866ab4-b63b-4cff-b9a5-1c3c8787ce9f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:20 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:20 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:20 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9f344c4b-3f7b-40c8-b244-a7c9b0d68dad tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-54aa8a74-b26a-4a11-bb61-6f2ec6cb2911-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-a7dda153-9edc-440b-a9ab-cadff6ebb7fb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-a7dda153-9edc-440b-a9ab-cadff6ebb7fb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb6cbb0-a330-4d41-9696-6d6a41b5542d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd3a9df-605c-4600-9cec-891da80f2bbd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:21 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb Sep 17 15:10:21 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd Sep 17 15:10:22 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" returned: 0 in 0.510s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb Sep 17 15:10:22 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd Sep 17 15:10:22 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-quobyte-a7dda153-9edc-440b-a9ab-cadff6ebb7fb" released by "delete_volume" :: held 0.892s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Created reservations ['248951f0-7af0-4c15-9070-684d803fecd9', 'b555e475-0d7f-479b-ad8e-f9a17f185b51', '619345bd-ac5d-43bc-a60a-b24136d9f835', 'abba4752-e2ab-45a1-89b2-59720511fe83'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:22 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd" released by "delete_volume" :: held 0.836s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:22 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['f80343ca-faac-4bfa-b012-283acd9be7cd', '46282a90-0f09-4f84-8256-d8ed145b28b7', '04075647-bcb8-4ffb-bf91-e36470b4619b', '66586931-efa5-4fb3-9a94-c4060d910127'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:22 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:22 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-045722b7-0cec-48e3-a347-9fddd61ad83d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-045722b7-0cec-48e3-a347-9fddd61ad83d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-045722b7-0cec-48e3-a347-9fddd61ad83d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-045722b7-0cec-48e3-a347-9fddd61ad83d" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7979fd97-4089-4971-b967-4907bd6d9cf2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:23 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.593s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Deleted volume successfully. Sep 17 15:10:23 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.489s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0b7fa284-1608-4336-a41f-e5dcf42131e3 tempest-VolumesSnapshotListTestJSON-1387269814 None] Lock "cinder-a7dda153-9edc-440b-a9ab-cadff6ebb7fb-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-923ecef4-8a37-41a4-8a4e-e718e5fefa61 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-d7b95bfd-88aa-4874-9d34-8a0e44e0c7cd-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:23 devstack sudo[98979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d Sep 17 15:10:23 devstack sudo[98979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:23 devstack sudo[98979]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d" returned: 0 in 0.600s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:23 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d Sep 17 15:10:23 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:24 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-045722b7-0cec-48e3-a347-9fddd61ad83d" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-045722b7-0cec-48e3-a347-9fddd61ad83d" released by "delete_volume" :: held 0.982s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['1c098b63-8477-43a9-9d2f-cc90bb0bdaa7', 'bbc7e2cc-01c8-4bcd-8cc6-4d08ad371056', '7032d6d6-b9e9-47a2-9013-5fc7efbb5814', '6f734c38-02b7-47e3-b343-af1c5bc318e6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:24 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:24 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:24 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e68bd81b-df4f-4f3c-8b8a-72a06b99814e tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-045722b7-0cec-48e3-a347-9fddd61ad83d-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-5358de0b-a00d-4f55-9af1-6ce65040ee97-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-5358de0b-a00d-4f55-9af1-6ce65040ee97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-5358de0b-a00d-4f55-9af1-6ce65040ee97" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-5358de0b-a00d-4f55-9af1-6ce65040ee97" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleting offline snapshot 5358de0b-a00d-4f55-9af1-6ce65040ee97 of volume 6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] snapshot_file for this snap is: volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c55c54-e3c3-4dce-b8fc-d372cd7442ef]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:25 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 Sep 17 15:10:25 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:26 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97" returned: 0 in 0.464s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[66366789-1fcf-4f32-add6-c4053ab4b0f2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:26 devstack sudo[98997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 Sep 17 15:10:26 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:26 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:26 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 Sep 17 15:10:26 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:27 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97" returned: 0 in 0.459s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:27 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97 Sep 17 15:10:27 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:27 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04.5358de0b-a00d-4f55-9af1-6ce65040ee97" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-5358de0b-a00d-4f55-9af1-6ce65040ee97" released by "_delete_snapshot" :: held 1.882s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" released by "delete_snapshot" :: held 1.916s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['d75c184c-68dd-4e17-890f-764439ebf8fe', '2d1eac2e-c167-4fbb-9f91-d776b00b9d62', '18b07365-fb10-4f82-93eb-4b3f622ae22f', 'd91056c2-6320-4961-9903-851687678617'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Delete snapshot completed successfully. Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-dcaa07f4-963c-44c6-9c21-ed6b374da72a tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-5358de0b-a00d-4f55-9af1-6ce65040ee97-delete_snapshot" released by "delete_snapshot" :: held 2.100s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-6c5ceda8-78d9-4ac4-8660-304cc731ae04-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-6c5ceda8-78d9-4ac4-8660-304cc731ae04-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfe6660-9576-49fb-979f-ae900cc278a8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:28 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 Sep 17 15:10:28 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:28 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:28 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04 Sep 17 15:10:28 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:28 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6c5ceda8-78d9-4ac4-8660-304cc731ae04" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-quobyte-6c5ceda8-78d9-4ac4-8660-304cc731ae04" released by "delete_volume" :: held 0.861s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Created reservations ['3c137b02-3f8b-4e42-8ad5-9f83377cc635', '71eda9cf-6731-45ac-955a-c1af5d91f7a5', 'cfab68fa-be5c-405f-bce3-712a687b3add', 'a174087c-62e0-43ec-b083-d7b44d422023'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:28 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:28 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:29 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:29 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Deleted volume successfully. Sep 17 15:10:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4555b85a-3fe1-4e54-8975-a234c0a491f1 tempest-CreateVolumesFromSnapshotTest-508439399 None] Lock "cinder-6c5ceda8-78d9-4ac4-8660-304cc731ae04-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Flow 'volume_create_manager' (c6484673-ecdf-45f5-9763-37ae61950098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1343dd04-bb07-4760-a5b0-453ca2af752c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1343dd04-bb07-4760-a5b0-453ca2af752c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-942698333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34d233f-5af9-4cbf-a009-08b18c9ee96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b46de87b04ef44508264102e1bc4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:35Z,use_quota=True,user_id='7a6c79230abb4c749893f7e55cb9f7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae833c4-bfa4-4fa3-a572-0045866f73ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae833c4-bfa4-4fa3-a572-0045866f73ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564a584b-3cd5-4d86-a60d-d8aa0a037c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (564a584b-3cd5-4d86-a60d-d8aa0a037c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34d233f-5af9-4cbf-a009-08b18c9ee96c', 'volume_name': 'volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ee4924-e35c-4252-84d3-227d9b5d6c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ee4924-e35c-4252-84d3-227d9b5d6c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748d7d23-634d-4bde-b7b5-515ea76b17ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Volume a34d233f-5af9-4cbf-a009-08b18c9ee96c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c', 'volume_size': 1} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-942698333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34d233f-5af9-4cbf-a009-08b18c9ee96c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b46de87b04ef44508264102e1bc4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:35Z,use_quota=True,user_id='7a6c79230abb4c749893f7e55cb9f7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Creating volume a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:34 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c 1073741824 Sep 17 15:10:34 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:35 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c 1073741824" returned: 0 in 0.560s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:35 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:35 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:35 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (748d7d23-634d-4bde-b7b5-515ea76b17ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f5340-9f0a-463a-aea5-0bfb66205649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Volume volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c (a34d233f-5af9-4cbf-a009-08b18c9ee96c): created successfully Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (644f5340-9f0a-463a-aea5-0bfb66205649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Flow 'volume_create_manager' (c6484673-ecdf-45f5-9763-37ae61950098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5e852bca-6846-4c6b-9fe7-0b62dcfafbe9 tempest-VolumeDependencyTests-981996722 None] Created volume successfully. Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Creating offline snapshot 52f62707-706c-47a9-938a-a3d41f3e2e16 of volume a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9aa5a1-3e93-4c60-ad09-d7f023255e21]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:37 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:37 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:37 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 0.453s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:37 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 1G Sep 17 15:10:37 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:38 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 1G" returned: 0 in 0.589s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:38 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:38 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:38 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:38 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 is being set with open permissions: ugo+rw Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:38 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:38 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:38 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:38 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info Sep 17 15:10:38 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:39 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:39 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info is being set with open permissions: ugo+rw Sep 17 15:10:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:39 devstack sudo[99056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info Sep 17 15:10:39 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:39 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.info" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.519s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f393f36b-9fe1-4d35-abb7-0893cd6d869d tempest-VolumeDependencyTests-981996722 None] Create snapshot completed successfully Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Flow 'volume_create_manager' (63a69331-2227-4b0a-af7e-26ae38e669dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba510321-c1ae-47e2-a9bd-7845723d8ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba510321-c1ae-47e2-a9bd-7845723d8ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1706330283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb15d1d-8330-4be9-a888-5056ff5bd1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b46de87b04ef44508264102e1bc4a792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52f62707-706c-47a9-938a-a3d41f3e2e16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:41Z,use_quota=True,user_id='7a6c79230abb4c749893f7e55cb9f7fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdc8c70-cb19-40dc-bdbb-dd933adcc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdc8c70-cb19-40dc-bdbb-dd933adcc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a712e34-1ad6-4dad-9788-3b240174de8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a712e34-1ad6-4dad-9788-3b240174de8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8fb15d1d-8330-4be9-a888-5056ff5bd1ed', 'volume_name': 'volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed', 'volume_size': 1, 'snapshot_id': '52f62707-706c-47a9-938a-a3d41f3e2e16'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a887840d-cfe4-43fe-b99d-b36786cb0641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a887840d-cfe4-43fe-b99d-b36786cb0641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998c2a7e-722e-4d9b-a443-04cd0848fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:41 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Volume 8fb15d1d-8330-4be9-a888-5056ff5bd1ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed', 'volume_size': 1, 'snapshot_id': '52f62707-706c-47a9-938a-a3d41f3e2e16'} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Creating volume 8fb15d1d-8330-4be9-a888-5056ff5bd1ed from snapshot 52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] snapshot: 52f62707-706c-47a9-938a-a3d41f3e2e16, volume: 8fb15d1d-8330-4be9-a888-5056ff5bd1ed, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c567114-19d7-4246-93dd-068d91fd1c5c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:41 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:41 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:41 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfe084c-2c30-4362-8f5a-72e3f6bf5478]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:41 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:41 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:42 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 0.651s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:10:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:10:42 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:10:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:42 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed Sep 17 15:10:42 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (b4b45023-d05b-4442-a906-b06b3ad7226d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675ad1ad-4665-4d12-b4fa-f75fa5218c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675ad1ad-4665-4d12-b4fa-f75fa5218c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767670045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27bcb00e-690b-4c75-9d40-dda2b7ade777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:43Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de82ea5-1b53-498f-8dec-6775e662358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de82ea5-1b53-498f-8dec-6775e662358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf2796b-8453-4c1c-98ac-ff13b9565d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf2796b-8453-4c1c-98ac-ff13b9565d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27bcb00e-690b-4c75-9d40-dda2b7ade777', 'volume_name': 'volume-27bcb00e-690b-4c75-9d40-dda2b7ade777', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a0f0b8-d41b-4293-93b7-9fea1737e23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a0f0b8-d41b-4293-93b7-9fea1737e23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d54e2b-ed8e-41b0-8eb8-692995b8ab28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume 27bcb00e-690b-4c75-9d40-dda2b7ade777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27bcb00e-690b-4c75-9d40-dda2b7ade777', 'volume_size': 1} Sep 17 15:10:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:51 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" returned: 0 in 9.101s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c, size 1024.00 MB, duration 9.10 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:10:51 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Converted 1024.00 MB image at 112.51 MB/s Sep 17 15:10:51 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed is being set with open permissions: ugo+rw Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:51 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed Sep 17 15:10:51 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:51 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" released by "_copy_volume_from_snapshot" :: held 10.634s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:DELETE=18,cinder:SELECT=148,cinder:UPDATE=162,cinder:INSERT=35 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" released by "_create_volume_from_snapshot" :: held 10.726s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.744s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.415s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-767670045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27bcb00e-690b-4c75-9d40-dda2b7ade777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:43Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume 27bcb00e-690b-4c75-9d40-dda2b7ade777 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:51 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 1073741824 Sep 17 15:10:51 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (998c2a7e-722e-4d9b-a443-04cd0848fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed', 'volume_size': 1, 'snapshot_id': '52f62707-706c-47a9-938a-a3d41f3e2e16'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c10b81-48e2-44dd-b21f-a97e5dce0de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Volume volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed (8fb15d1d-8330-4be9-a888-5056ff5bd1ed): created successfully Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c10b81-48e2-44dd-b21f-a97e5dce0de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Flow 'volume_create_manager' (63a69331-2227-4b0a-af7e-26ae38e669dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2b1cf4d3-338c-4c38-b60f-2cd31e6e9b5f tempest-VolumeDependencyTests-981996722 None] Created volume successfully. Sep 17 15:10:52 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 1073741824" returned: 0 in 0.539s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:52 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 Sep 17 15:10:52 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:52 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d54e2b-ed8e-41b0-8eb8-692995b8ab28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27bcb00e-690b-4c75-9d40-dda2b7ade777', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b592c6d-32e4-4179-8503-3cc89ee0201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 (27bcb00e-690b-4c75-9d40-dda2b7ade777): created successfully Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b592c6d-32e4-4179-8503-3cc89ee0201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (b4b45023-d05b-4442-a906-b06b3ad7226d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a35230d8-d245-4e5e-8f76-587efdfcf8d7 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-52f62707-706c-47a9-938a-a3d41f3e2e16-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-52f62707-706c-47a9-938a-a3d41f3e2e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Deleting offline snapshot 52f62707-706c-47a9-938a-a3d41f3e2e16 of volume a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] snapshot_file for this snap is: volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f232a5-d128-4645-bbef-ab9d8bbb8deb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:53 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:53 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:54 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d7e986-74ef-4cf5-b78c-4b37df25543f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:54 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:54 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (4a388882-99fb-4834-9659-b497718f59d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac59021-7e80-4fac-80c7-2338794deba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ac59021-7e80-4fac-80c7-2338794deba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060870590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3cba52-3615-4b8a-bc53-fb7cea84ebb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:54Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380498bc-249b-42ad-8d91-a42120d386a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380498bc-249b-42ad-8d91-a42120d386a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458e43c-ed80-4c95-ab2c-6a570a1571f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0458e43c-ed80-4c95-ab2c-6a570a1571f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d3cba52-3615-4b8a-bc53-fb7cea84ebb7', 'volume_name': 'volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc50a5f-a515-4c7e-b587-34edc953c8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc50a5f-a515-4c7e-b587-34edc953c8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda179ca-de91-4d81-bfb0-b51070f707e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:54 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume 1d3cba52-3615-4b8a-bc53-fb7cea84ebb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7', 'volume_size': 1} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2060870590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3cba52-3615-4b8a-bc53-fb7cea84ebb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:54Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume 1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:54 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:54 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 1073741824 Sep 17 15:10:54 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (8977984d-366e-4b9a-b7f5-ab0b6f0ab35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:54 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c7b6dd-96cc-45ac-8be0-e1141b9f1a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c7b6dd-96cc-45ac-8be0-e1141b9f1a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475050755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab490174-40c6-461f-a04c-4b777181b2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:55Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a760eae7-765a-49e7-9085-0b8f2cdddd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a760eae7-765a-49e7-9085-0b8f2cdddd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a33261-618d-42b6-baae-cfc28a192555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91a33261-618d-42b6-baae-cfc28a192555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab490174-40c6-461f-a04c-4b777181b2a9', 'volume_name': 'volume-ab490174-40c6-461f-a04c-4b777181b2a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd82e001-baa5-4790-ae40-bb258663197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd82e001-baa5-4790-ae40-bb258663197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd2b0e-ad59-494e-a115-da1643b774f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume ab490174-40c6-461f-a04c-4b777181b2a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab490174-40c6-461f-a04c-4b777181b2a9', 'volume_size': 1} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:55 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 1.128s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:55 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:55 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (90684fb2-cf69-4a7d-987d-43e1b3d98e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe64b8b-2377-4334-9f52-e12da0f43c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe64b8b-2377-4334-9f52-e12da0f43c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243234019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ebad05-ea7c-400b-94f9-a2e92f88359c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:55Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409e72e2-3433-41cb-a9d4-17e0874e5b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409e72e2-3433-41cb-a9d4-17e0874e5b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e508079-f995-4f8b-81ac-7880f2663903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e508079-f995-4f8b-81ac-7880f2663903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ebad05-ea7c-400b-94f9-a2e92f88359c', 'volume_name': 'volume-57ebad05-ea7c-400b-94f9-a2e92f88359c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773d6010-85ff-4e0f-aa16-048b821d81a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773d6010-85ff-4e0f-aa16-048b821d81a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e986818-6b59-429e-bf3e-5b2a05210877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:55 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume 57ebad05-ea7c-400b-94f9-a2e92f88359c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ebad05-ea7c-400b-94f9-a2e92f88359c', 'volume_size': 1} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 1073741824" returned: 0 in 1.039s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:55 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 Sep 17 15:10:55 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:55 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (493e71af-64fa-4eb1-adb4-f3b58dc1cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bb2ae3-1440-4997-b80d-a669c6a989d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bb2ae3-1440-4997-b80d-a669c6a989d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811225314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7315c52-2caa-45c2-b9ea-db3ef9584044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:56Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bff30c3-81ff-4763-a941-bd51a8079f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bff30c3-81ff-4763-a941-bd51a8079f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7022c622-3606-47aa-bcb4-6d7c76d41f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7022c622-3606-47aa-bcb4-6d7c76d41f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7315c52-2caa-45c2-b9ea-db3ef9584044', 'volume_name': 'volume-f7315c52-2caa-45c2-b9ea-db3ef9584044', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521f6376-a026-4412-af0d-5534281c695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521f6376-a026-4412-af0d-5534281c695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4638756b-fb93-4006-a4f0-a2e7d82498cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume f7315c52-2caa-45c2-b9ea-db3ef9584044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7315c52-2caa-45c2-b9ea-db3ef9584044', 'volume_size': 1} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:56 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.940s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:56 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16 Sep 17 15:10:56 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:56 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" returned: 0 in 0.564s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-475050755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab490174-40c6-461f-a04c-4b777181b2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:55Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume ab490174-40c6-461f-a04c-4b777181b2a9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:56 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda179ca-de91-4d81-bfb0-b51070f707e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca09af-82f3-4190-b2b1-dfafe583b60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 1073741824 Sep 17 15:10:56 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 (1d3cba52-3615-4b8a-bc53-fb7cea84ebb7): created successfully Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca09af-82f3-4190-b2b1-dfafe583b60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (4a388882-99fb-4834-9659-b497718f59d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d87fe784-d511-44cb-be67-e2513398d415 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:10:56 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c.52f62707-706c-47a9-938a-a3d41f3e2e16" returned: 0 in 0.581s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (e61482fc-9b3e-4154-8fbd-2a1828c93bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70bec35-3395-4017-ba36-acf00edccb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-52f62707-706c-47a9-938a-a3d41f3e2e16" released by "_delete_snapshot" :: held 3.482s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70bec35-3395-4017-ba36-acf00edccb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23643503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:57Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a30225b-e981-4f8c-b002-730b09fbb362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a30225b-e981-4f8c-b002-730b09fbb362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cfe589-1651-43bf-85d7-6d58d9655e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42cfe589-1651-43bf-85d7-6d58d9655e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7', 'volume_name': 'volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f598b41-2418-4fb8-ac19-85e5dfc807b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f598b41-2418-4fb8-ac19-85e5dfc807b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e7e6f-3966-417c-a122-d7eda4c3fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume 7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7', 'volume_size': 1} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" released by "delete_snapshot" :: held 3.567s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:57 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:57 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Created reservations ['7c0502bf-c404-49a0-9fce-d578d89e6ce3', 'fa94c83d-4684-4fc9-895b-d7193f37014f', 'e6f38654-07fe-4dd2-b134-3cf624280672', 'e8353077-76e5-44ae-b0d8-2968a5209c07'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Delete snapshot completed successfully. Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8b52d68c-fb4e-4fc6-bc19-5c9e7920ec1a tempest-VolumeDependencyTests-981996722 None] Lock "cinder-52f62707-706c-47a9-938a-a3d41f3e2e16-delete_snapshot" released by "delete_snapshot" :: held 3.798s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:57 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 1073741824" returned: 0 in 0.917s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:57 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 Sep 17 15:10:57 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:57 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.368s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:10:57 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.054s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-243234019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ebad05-ea7c-400b-94f9-a2e92f88359c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:55Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume 57ebad05-ea7c-400b-94f9-a2e92f88359c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:57 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:57 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c 1073741824 Sep 17 15:10:57 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54cd2b0e-ad59-494e-a115-da1643b774f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab490174-40c6-461f-a04c-4b777181b2a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ff28a3-2e4c-4d91-997e-68037ebcce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-ab490174-40c6-461f-a04c-4b777181b2a9 (ab490174-40c6-461f-a04c-4b777181b2a9): created successfully Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07ff28a3-2e4c-4d91-997e-68037ebcce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (8977984d-366e-4b9a-b7f5-ab0b6f0ab35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d6d7bb1c-a674-4c2b-bf18-850b3bab28f0 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-a34d233f-5af9-4cbf-a009-08b18c9ee96c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "cinder-a34d233f-5af9-4cbf-a009-08b18c9ee96c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee9ba00-b0c9-4242-86d3-4ffc419d9d54]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (03d8adc5-5c6d-4602-84c0-01d4f39a2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbadc8c7-cfa6-44c1-8581-a9c57c0ad893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbadc8c7-cfa6-44c1-8581-a9c57c0ad893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-143528364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063d8e58-8849-46e8-80c7-9eac0953818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:58Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b0b59ec-349e-4fdb-8211-70008c18682b),volume_type_id=6b0b59ec-349e-4fdb-8211-70008c18682b)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96fb372-0613-4f1c-ba31-950e979593b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96fb372-0613-4f1c-ba31-950e979593b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e81bf82-837c-4fda-95c7-37c939464934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e81bf82-837c-4fda-95c7-37c939464934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '063d8e58-8849-46e8-80c7-9eac0953818c', 'volume_name': 'volume-063d8e58-8849-46e8-80c7-9eac0953818c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c15ee8b-97f1-4f06-bd4b-5045687a0adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c15ee8b-97f1-4f06-bd4b-5045687a0adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7f2d02-5d4b-4722-8887-3c21f6bcccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume 063d8e58-8849-46e8-80c7-9eac0953818c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-063d8e58-8849-46e8-80c7-9eac0953818c', 'volume_size': 1} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:58 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:58 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:58 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c 1073741824" returned: 0 in 0.880s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:58 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c Sep 17 15:10:58 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (be195baf-9eec-4f06-97e4-02a1c7e618f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd4d10e-356d-4ef5-9207-8b0a610639f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd4d10e-356d-4ef5-9207-8b0a610639f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1627705844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78113cc0-33c2-4757-83eb-2ab6141be61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:59Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08aa6414-2413-4635-b475-b063c66a869a),volume_type_id=08aa6414-2413-4635-b475-b063c66a869a)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda03006-ed55-44fb-8a8e-45833f818568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bda03006-ed55-44fb-8a8e-45833f818568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f368153-ec83-46e4-b461-0e8c768a310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f368153-ec83-46e4-b461-0e8c768a310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78113cc0-33c2-4757-83eb-2ab6141be61a', 'volume_name': 'volume-78113cc0-33c2-4757-83eb-2ab6141be61a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5befa72b-8f73-4508-a0d9-29dbd92f8d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5befa72b-8f73-4508-a0d9-29dbd92f8d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fa239-83fd-4db0-a4dc-8c9154b954d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Volume 78113cc0-33c2-4757-83eb-2ab6141be61a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78113cc0-33c2-4757-83eb-2ab6141be61a', 'volume_size': 1} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 0.707s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:58 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c Sep 17 15:10:58 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:59 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c" returned: 0 in 0.476s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.027s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-811225314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7315c52-2caa-45c2-b9ea-db3ef9584044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:56Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume f7315c52-2caa-45c2-b9ea-db3ef9584044 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:10:59 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:59 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-a34d233f-5af9-4cbf-a009-08b18c9ee96c" returned: 0 in 0.337s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:59 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 1073741824 Sep 17 15:10:59 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e986818-6b59-429e-bf3e-5b2a05210877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ebad05-ea7c-400b-94f9-a2e92f88359c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bec8b2-2333-4295-a86a-a49520c35e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-a34d233f-5af9-4cbf-a009-08b18c9ee96c" released by "delete_volume" :: held 1.166s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:59 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-57ebad05-ea7c-400b-94f9-a2e92f88359c (57ebad05-ea7c-400b-94f9-a2e92f88359c): created successfully Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bec8b2-2333-4295-a86a-a49520c35e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (90684fb2-cf69-4a7d-987d-43e1b3d98e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-73159bba-048a-42b2-ba95-ccab70726cbe tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Created reservations ['8a65ba35-cf9d-4f07-a04b-b48944175581', 'e093ad9f-20ba-49d1-94ff-7e2979db540d', '556866ba-94c7-4f7d-92b2-a0769ac76c09', '59084237-14bc-4454-87e7-aca9df492ce6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:59 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:10:59 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (7a911047-6b56-4d42-8bd4-b8d4cb2841f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:10:59 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41780ec6-3d5a-42c4-ba7c-4113f0fe5712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 1073741824" returned: 0 in 0.673s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:59 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41780ec6-3d5a-42c4-ba7c-4113f0fe5712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1228560165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a87f92-0dbe-4720-a8cb-619d41819480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:00Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6adf7a2-3c8b-493b-a60b-d4773e99b2de),volume_type_id=b6adf7a2-3c8b-493b-a60b-d4773e99b2de)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf93182e-1c43-4f73-a12e-d40469121c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf93182e-1c43-4f73-a12e-d40469121c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69333c2-8603-4d3a-afa3-ad440ad56f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:10:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Deleted volume successfully. Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:10:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ec9497af-1855-4ab8-bb26-148e151411e4 tempest-VolumeDependencyTests-981996722 None] Lock "cinder-a34d233f-5af9-4cbf-a009-08b18c9ee96c-delete_volume" released by "delete_volume" :: held 1.978s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:10:59 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 Sep 17 15:10:59 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69333c2-8603-4d3a-afa3-ad440ad56f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9a87f92-0dbe-4720-a8cb-619d41819480', 'volume_name': 'volume-c9a87f92-0dbe-4720-a8cb-619d41819480', 'volume_size': 1, 'image_id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1304074167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43f8dddf6873410195b4c005905c2f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'created_at': datetime.datetime(2026, 9, 17, 13, 10, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bcc4c3-501f-41a7-89fa-b5d8bf4b1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bcc4c3-501f-41a7-89fa-b5d8bf4b1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a63f10-6f69-4bb4-8472-5413b1ba9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume c9a87f92-0dbe-4720-a8cb-619d41819480: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9a87f92-0dbe-4720-a8cb-619d41819480', 'volume_size': 1, 'image_id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1304074167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43f8dddf6873410195b4c005905c2f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'created_at': datetime.datetime(2026, 9, 17, 13, 10, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32/file', 'properties': {}}, 'image_service': } Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Trying to clone c9a87f92-0dbe-4720-a8cb-619d41819480 from image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:11:00 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-8fb15d1d-8330-4be9-a888-5056ff5bd1ed-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.368s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-23643503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b5a754241774673ad3324dfe3af7dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:57Z,use_quota=True,user_id='c861f15c821a460097aec350359e7109',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Creating volume 7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4638756b-fb93-4006-a4f0-a2e7d82498cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7315c52-2caa-45c2-b9ea-db3ef9584044', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:00 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 1073741824 Sep 17 15:11:00 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175bd67c-ace6-422c-8ff6-6177a3b44af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "cinder-8fb15d1d-8330-4be9-a888-5056ff5bd1ed-delete_volume" acquired by "delete_volume" :: waited 0.126s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 (f7315c52-2caa-45c2-b9ea-db3ef9584044): created successfully Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (175bd67c-ace6-422c-8ff6-6177a3b44af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (493e71af-64fa-4eb1-adb4-f3b58dc1cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6bc9cc3b-ad50-47a0-bd8b-58c583aa454f tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Acquiring lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6111f81d-1621-4434-9efb-c54956b36e55]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:00 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed Sep 17 15:11:00 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:00 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 1073741824" returned: 0 in 0.590s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:01 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 Sep 17 15:11:01 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:01 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" returned: 0 in 0.658s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:01 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed Sep 17 15:11:01 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:01 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" returned: 0 in 0.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.174s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-143528364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063d8e58-8849-46e8-80c7-9eac0953818c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:58Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b0b59ec-349e-4fdb-8211-70008c18682b),volume_type_id=6b0b59ec-349e-4fdb-8211-70008c18682b)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Creating volume 063d8e58-8849-46e8-80c7-9eac0953818c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:01 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:01 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c 1073741824 Sep 17 15:11:01 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0e7e6f-3966-417c-a122-d7eda4c3fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84635fc1-d4b2-4352-b9c5-c1b1702b0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:01 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Volume volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 (7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7): created successfully Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84635fc1-d4b2-4352-b9c5-c1b1702b0a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Flow 'volume_create_manager' (e61482fc-9b3e-4154-8fbd-2a1828c93bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1b0f18a3-fb8e-44e2-857a-ba7e0747a59e tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created volume successfully. Sep 17 15:11:01 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "cinder-quobyte-8fb15d1d-8330-4be9-a888-5056ff5bd1ed" released by "delete_volume" :: held 1.212s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Created reservations ['e84779f9-c0ba-49c5-9ed1-3db73234f2d7', 'f6a3b455-5476-4999-8da5-434353d4aabd', 'e05361c6-ae9d-4b33-90ca-82a15455b1cd', 'e86c38e5-e437-46f8-a473-7e5adff4922a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:01 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:01 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:02 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c 1073741824" returned: 0 in 0.651s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:02 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:02 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c Sep 17 15:11:02 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Deleted volume successfully. Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13f11cdf-4a2e-47b2-aa67-6271fa01d90d tempest-VolumeDependencyTests-981996722 None] Lock "cinder-8fb15d1d-8330-4be9-a888-5056ff5bd1ed-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:02 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.687s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1627705844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78113cc0-33c2-4757-83eb-2ab6141be61a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:10:59Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08aa6414-2413-4635-b475-b063c66a869a),volume_type_id=08aa6414-2413-4635-b475-b063c66a869a)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Creating volume 78113cc0-33c2-4757-83eb-2ab6141be61a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:02 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a 1073741824 Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7f2d02-5d4b-4722-8887-3c21f6bcccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063d8e58-8849-46e8-80c7-9eac0953818c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff79d70-a52d-4b8c-aa4e-9cd317210096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume volume-063d8e58-8849-46e8-80c7-9eac0953818c (063d8e58-8849-46e8-80c7-9eac0953818c): created successfully Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ff79d70-a52d-4b8c-aa4e-9cd317210096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (03d8adc5-5c6d-4602-84c0-01d4f39a2294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-36c8ba02-e2a5-4b57-abea-fb666fad6298 tempest-TestInstancesWithCinderVolumes-849510081 None] Created volume successfully. Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2065800f-91a5-4df7-9393-e030619c416b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:03 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 Sep 17 15:11:03 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:03 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a 1073741824" returned: 0 in 0.673s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:03 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a Sep 17 15:11:03 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:03 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" returned: 0 in 0.645s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:03 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7 Sep 17 15:11:03 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:03 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045fa239-83fd-4db0-a4dc-8c9154b954d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78113cc0-33c2-4757-83eb-2ab6141be61a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d8339a-e466-42e5-bad1-74be00f0d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Volume volume-78113cc0-33c2-4757-83eb-2ab6141be61a (78113cc0-33c2-4757-83eb-2ab6141be61a): created successfully Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d8339a-e466-42e5-bad1-74be00f0d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (be195baf-9eec-4f06-97e4-02a1c7e618f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-df9fede9-c41c-4e56-98f2-f8b2228ab6bf tempest-TestInstancesWithCinderVolumes-849510081 None] Created volume successfully. Sep 17 15:11:03 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7" released by "delete_volume" :: held 1.196s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['88acc3d9-6e1a-4b95-b71f-018a236b5ccf', 'c775a8df-c0fc-466e-82cc-1197d0bfdabe', '5deb076d-b2a2-4c2f-aa43-5afd70c47175', 'f7a9c981-dd07-4593-9339-d68715f4518b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:04 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:04 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:04 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e9b51d8d-d5f3-4a02-9ba3-20c090c43468 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-7e6cb1ca-be69-43b8-96b4-b2ba8c79dbc7-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-f7315c52-2caa-45c2-b9ea-db3ef9584044-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-f7315c52-2caa-45c2-b9ea-db3ef9584044-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-f7315c52-2caa-45c2-b9ea-db3ef9584044" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-f7315c52-2caa-45c2-b9ea-db3ef9584044" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16dcb01-2b97-484f-8040-b1eaf99f1e08]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:05 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 Sep 17 15:11:05 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:05 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044" returned: 0 in 0.469s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:05 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044 Sep 17 15:11:05 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:05 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f7315c52-2caa-45c2-b9ea-db3ef9584044" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-f7315c52-2caa-45c2-b9ea-db3ef9584044" released by "delete_volume" :: held 0.837s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['175ffa58-3792-435c-82a3-856cfde27520', 'b72bd319-1759-45cc-954d-e7dae8ed937d', '6a4ef8b5-a6b8-482e-b600-edc14079bc28', 'd0fad642-c7ef-4f6a-8d3f-7111d536a4d6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:06 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:06 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-57ebad05-ea7c-400b-94f9-a2e92f88359c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-57ebad05-ea7c-400b-94f9-a2e92f88359c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-57ebad05-ea7c-400b-94f9-a2e92f88359c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-57ebad05-ea7c-400b-94f9-a2e92f88359c" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb948b8-9e0b-4946-aff9-b8ddfd0c1e9b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:06 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:06 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c Sep 17 15:11:06 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a3c90cbd-2200-4fa5-9426-0d582f53cfe8 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-f7315c52-2caa-45c2-b9ea-db3ef9584044-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD, size 20.69 MB, duration 6.34 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:11:06 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Image download 20.69 MB at 3.26 MB/s Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a9a8db-7fa1-4a8a-b495-9892bc4546c7]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:06 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD Sep 17 15:11:06 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:06 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c" returned: 0 in 0.519s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:06 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c Sep 17 15:11:06 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:07 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Temporary image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 is fetched for user 4e48051a1b9e496b94820c36fc631c37. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=135,cinder:INSERT=53,cinder:UPDATE=207,cinder:DELETE=10 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:11:07 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014843e-bced-4cea-bb37-33bcb8f8570a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57ebad05-ea7c-400b-94f9-a2e92f88359c" returned: 0 in 0.369s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-57ebad05-ea7c-400b-94f9-a2e92f88359c" released by "delete_volume" :: held 0.982s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['3ceb4ab2-9bce-48fb-a264-2f194941035b', 'ab277654-c9b0-4957-9c2f-d5cf70dab6b7', '4f5bda37-4e77-4b82-b58a-661b262c0618', 'c6c41eed-b479-42c7-992b-9db5aab2ff8e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:07 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD Sep 17 15:11:07 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:07 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:07 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:07 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1228560165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9a87f92-0dbe-4720-a8cb-619d41819480,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f8dddf6873410195b4c005905c2f44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:00Z,use_quota=True,user_id='4e48051a1b9e496b94820c36fc631c37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b6adf7a2-3c8b-493b-a60b-d4773e99b2de),volume_type_id=b6adf7a2-3c8b-493b-a60b-d4773e99b2de)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Creating volume c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:07 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:07 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1073741824 Sep 17 15:11:07 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:07 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.319s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-be269570-176a-45b0-a6a2-9cf46a974c92 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-57ebad05-ea7c-400b-94f9-a2e92f88359c-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:08 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1073741824" returned: 0 in 0.613s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:08 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 Sep 17 15:11:08 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-ab490174-40c6-461f-a04c-4b777181b2a9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-ab490174-40c6-461f-a04c-4b777181b2a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-ab490174-40c6-461f-a04c-4b777181b2a9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-ab490174-40c6-461f-a04c-4b777181b2a9" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb359337-ff6a-4b86-bf56-e2b897895ead]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:08 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:08 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 Sep 17 15:11:08 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Attempting download of ccffd8b9-5dba-4495-ae10-ca3c80d82e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}])) to volume c9a87f92-0dbe-4720-a8cb-619d41819480. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a473de-68b9-4902-b344-4696b8c95b3f]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:08 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq Sep 17 15:11:08 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:09 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9" returned: 0 in 0.520s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:09 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9 Sep 17 15:11:09 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:09 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq" returned: 0 in 0.499s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:09 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq Sep 17 15:11:09 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:09 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ab490174-40c6-461f-a04c-4b777181b2a9" returned: 0 in 0.570s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-ab490174-40c6-461f-a04c-4b777181b2a9" released by "delete_volume" :: held 1.190s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['db2475d9-92a6-457e-b5f3-efece43cf631', 'f55b7195-b266-4f56-8991-feee50ce3047', '7928633a-358e-482f-aea0-0047a5421fa0', 'edad6c95-eae3-4d85-b9e7-291c3fbe795f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:09 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq" returned: 1 in 0.587s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_52jpszyq' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef90175-96c5-4ffe-bfac-a707903fbc46]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:10 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:10 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:10 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD Sep 17 15:11:10 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:10 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] ccffd8b9-5dba-4495-ae10-ca3c80d82e32 was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:10 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.490s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:10 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 Sep 17 15:11:10 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6c7abe8a-d60e-4116-9f47-899d4b380ada tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-ab490174-40c6-461f-a04c-4b777181b2a9-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Flow 'volume_create_manager' (d4ff5b53-660c-4c28-9bc3-78c3f530fc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679abcef-658d-4a1d-8af7-dc9d672a3df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679abcef-658d-4a1d-8af7-dc9d672a3df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed641ee-31ae-4ed5-9f59-41e0d850b9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c644e6ba024767b0bf79fa8aa44b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:11Z,use_quota=True,user_id='974bbcbcdb6b4c30bbeaddf937ff2b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6a6a18-b009-4efc-8e6c-4cf08a2280c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6a6a18-b009-4efc-8e6c-4cf08a2280c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabba22f-3c0b-43b3-97f0-3b6b9ae486ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f575e9f4-14e1-4f59-8754-32ad6c6821ad]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:11 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 Sep 17 15:11:11 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabba22f-3c0b-43b3-97f0-3b6b9ae486ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ed641ee-31ae-4ed5-9f59-41e0d850b9fe', 'volume_name': 'volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe', 'volume_size': 1, 'image_id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bcae6ab7583ab6d217fae2e09332fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32c644e6ba024767b0bf79fa8aa44b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9a3487d9f9ca8a7cb89a51320b54725b3a81d08ad12ddd31ffc831db6e89db86f8f07c03c2251eb9ef3db5efb236c7e905c5a2b7cb00abf6decf00db979b077', 'id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'created_at': datetime.datetime(2026, 9, 17, 13, 11, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 11, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2974d8a-44c7-475b-8983-77b2c013d785/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88036a0-cc5f-429c-8810-b47e4afe924a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88036a0-cc5f-429c-8810-b47e4afe924a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df02d9bf-2200-4dd3-bd77-b4f194252697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe', 'volume_size': 1, 'image_id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bcae6ab7583ab6d217fae2e09332fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32c644e6ba024767b0bf79fa8aa44b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9a3487d9f9ca8a7cb89a51320b54725b3a81d08ad12ddd31ffc831db6e89db86f8f07c03c2251eb9ef3db5efb236c7e905c5a2b7cb00abf6decf00db979b077', 'id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'created_at': datetime.datetime(2026, 9, 17, 13, 11, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 11, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2974d8a-44c7-475b-8983-77b2c013d785/file', 'properties': {}}, 'image_service': } Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Trying to clone 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe from image e2974d8a-44c7-475b-8983-77b2c013d785 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:11:11 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc935c17-b64c-452b-a6da-46bf341d376b]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:11 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" returned: 0 in 0.604s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:11 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7 Sep 17 15:11:11 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:11 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:11 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:11 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7" released by "delete_volume" :: held 1.024s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['5b151a70-b92e-407b-8e58-efdd4267adf2', '9500eb59-2a32-4e44-8737-d91a9c5ceef0', 'e4fe0850-209d-497e-8f24-049545570a15', '84257b05-86fc-4a9d-8a3e-46bd8077646f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:12 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:12 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:12 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:12 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:12 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:12 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a1615803-a40b-4579-b0a7-8f425e319bc6 tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-1d3cba52-3615-4b8a-bc53-fb7cea84ebb7-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:12 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 1 in 0.599s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Temporary image e2974d8a-44c7-475b-8983-77b2c013d785 is fetched for user 974bbcbcdb6b4c30bbeaddf937ff2b7a. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a219c-b3a9-4f63-841f-9c67dbcb9f47]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:13 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:13 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-27bcb00e-690b-4c75-9d40-dda2b7ade777-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-27bcb00e-690b-4c75-9d40-dda2b7ade777-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "cinder-quobyte-27bcb00e-690b-4c75-9d40-dda2b7ade777" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-27bcb00e-690b-4c75-9d40-dda2b7ade777" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73e6ece-f74e-429b-a7a4-eb6514ee16dc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:13 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480" returned: 0 in 2.816s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ccffd8b9-5dba-4495-ae10-ca3c80d82e32_p5y7d5xrdevstack@QuobyteHD, size 112.00 MB, duration 2.82 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:11:13 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Converted 112.00 MB image at 39.74 MB/s Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:13 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1G Sep 17 15:11:13 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:13 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 0 in 0.474s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:13 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 Sep 17 15:11:13 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:13 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:13 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:13 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 1G" returned: 0 in 0.642s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Downloaded image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 ((None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}])) to volume c9a87f92-0dbe-4720-a8cb-619d41819480 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:11:13 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Temporary image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 for user 4e48051a1b9e496b94820c36fc631c37 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Marking volume c9a87f92-0dbe-4720-a8cb-619d41819480 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777" returned: 0 in 0.688s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Copying metadata from image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 to c9a87f92-0dbe-4720-a8cb-619d41819480. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:11:13 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Creating volume glance metadata for volume c9a87f92-0dbe-4720-a8cb-619d41819480 backed by image ccffd8b9-5dba-4495-ae10-ca3c80d82e32 with: {'image_id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'image_name': 'tempest-scenario-img--1304074167', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:11:14 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777 Sep 17 15:11:14 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a63f10-6f69-4bb4-8472-5413b1ba9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9a87f92-0dbe-4720-a8cb-619d41819480', 'volume_size': 1, 'image_id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1304074167', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '43f8dddf6873410195b4c005905c2f44', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ccffd8b9-5dba-4495-ae10-ca3c80d82e32', 'created_at': datetime.datetime(2026, 9, 17, 13, 10, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 10, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ccffd8b9-5dba-4495-ae10-ca3c80d82e32/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:14 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc38f97-b89e-45d1-acd5-470c2a384311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 1 in 0.746s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed641ee-31ae-4ed5-9f59-41e0d850b9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32c644e6ba024767b0bf79fa8aa44b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:11Z,use_quota=True,user_id='974bbcbcdb6b4c30bbeaddf937ff2b7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Creating volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Volume volume-c9a87f92-0dbe-4720-a8cb-619d41819480 (c9a87f92-0dbe-4720-a8cb-619d41819480): created successfully Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc38f97-b89e-45d1-acd5-470c2a384311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Flow 'volume_create_manager' (7a911047-6b56-4d42-8bd4-b8d4cb2841f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:14 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1073741824 Sep 17 15:11:14 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-77520ee7-6e49-45f5-9540-2ece19ea6951 tempest-TestInstancesWithCinderVolumes-849510081 None] Created volume successfully. Sep 17 15:11:14 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-27bcb00e-690b-4c75-9d40-dda2b7ade777" returned: 0 in 0.529s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-quobyte-27bcb00e-690b-4c75-9d40-dda2b7ade777" released by "delete_volume" :: held 1.289s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Created reservations ['90431c88-d064-4b9e-8487-9c22b88e9149', '345c69b8-d268-466c-bc1b-5766b7b88d43', 'dee7016c-7660-43cc-b42e-cc103c3779f7', 'fbfb063a-3f79-4fa8-95a8-9090c2cd7d29'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:14 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:14 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:14 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1073741824" returned: 0 in 0.786s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:15 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe Sep 17 15:11:15 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:15 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Deleted volume successfully. Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e6573653-b92b-47a5-8733-e2e75c623aaf tempest-CreateVolumesFromSourceVolumeTest-1172955215 None] Lock "cinder-27bcb00e-690b-4c75-9d40-dda2b7ade777-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:15 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Attempting download of e2974d8a-44c7-475b-8983-77b2c013d785 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}])) to volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfed26b8-60c1-420e-9866-3051fa49cbb8]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:15 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2 Sep 17 15:11:15 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:16 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2" returned: 0 in 0.616s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:16 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2 Sep 17 15:11:16 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:16 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2" returned: 1 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2974d8a-44c7-475b-8983-77b2c013d785_hrllg8z2' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[622a94f2-5236-435a-81c6-f616bcd32001]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:16 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:16 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:16 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 0 in 0.468s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:17 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD Sep 17 15:11:17 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:17 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD" returned: 1 in 0.575s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:11:17 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] e2974d8a-44c7-475b-8983-77b2c013d785 was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:11:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:17 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe Sep 17 15:11:17 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:18 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" returned: 0 in 0.894s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:18 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2974d8a-44c7-475b-8983-77b2c013d785_c9byin37devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:11:18 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:11:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:18 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1G Sep 17 15:11:18 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:19 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe 1G" returned: 0 in 0.718s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Downloaded image e2974d8a-44c7-475b-8983-77b2c013d785 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}])) to volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Temporary image e2974d8a-44c7-475b-8983-77b2c013d785 for user 974bbcbcdb6b4c30bbeaddf937ff2b7a is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Marking volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Copying metadata from image e2974d8a-44c7-475b-8983-77b2c013d785 to 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Creating volume glance metadata for volume 6ed641ee-31ae-4ed5-9f59-41e0d850b9fe backed by image e2974d8a-44c7-475b-8983-77b2c013d785 with: {'image_id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bcae6ab7583ab6d217fae2e09332fa5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df02d9bf-2200-4dd3-bd77-b4f194252697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe', 'volume_size': 1, 'image_id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2974d8a-44c7-475b-8983-77b2c013d785', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bcae6ab7583ab6d217fae2e09332fa5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '32c644e6ba024767b0bf79fa8aa44b18', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b9a3487d9f9ca8a7cb89a51320b54725b3a81d08ad12ddd31ffc831db6e89db86f8f07c03c2251eb9ef3db5efb236c7e905c5a2b7cb00abf6decf00db979b077', 'id': 'e2974d8a-44c7-475b-8983-77b2c013d785', 'created_at': datetime.datetime(2026, 9, 17, 13, 11, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 11, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2974d8a-44c7-475b-8983-77b2c013d785/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6626e2f0-4664-49d9-8601-e9ca830add7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Volume volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe (6ed641ee-31ae-4ed5-9f59-41e0d850b9fe): created successfully Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6626e2f0-4664-49d9-8601-e9ca830add7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Flow 'volume_create_manager' (d4ff5b53-660c-4c28-9bc3-78c3f530fc92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5f638164-de61-4634-b31c-3cfeccf31126 tempest-VolumeImageDependencyTests-427866895 None] Created volume successfully. Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Flow 'volume_create_manager' (9bd4de89-bbeb-4b02-96a8-3e4480aeb57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97065c18-0df6-4e55-af31-93df0a4e24ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97065c18-0df6-4e55-af31-93df0a4e24ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-622475656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacac0ed-dbdc-42fb-bc89-405f0647f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f247be7e19841cdafd5733ae60865da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:20Z,use_quota=True,user_id='74b437636a16434aba4b126af1e796b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3468323-efba-45c1-be1e-ee11ee0f3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3468323-efba-45c1-be1e-ee11ee0f3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5330653-f154-422f-8695-00a4c81fe3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5330653-f154-422f-8695-00a4c81fe3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacac0ed-dbdc-42fb-bc89-405f0647f997', 'volume_name': 'volume-eacac0ed-dbdc-42fb-bc89-405f0647f997', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b147ca-bed1-4644-90f7-44ba5175d333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b147ca-bed1-4644-90f7-44ba5175d333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f2b5ca-ca5d-48eb-ae2b-cc63b6e5f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Volume eacac0ed-dbdc-42fb-bc89-405f0647f997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacac0ed-dbdc-42fb-bc89-405f0647f997', 'volume_size': 1} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-622475656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacac0ed-dbdc-42fb-bc89-405f0647f997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f247be7e19841cdafd5733ae60865da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:20Z,use_quota=True,user_id='74b437636a16434aba4b126af1e796b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Creating volume eacac0ed-dbdc-42fb-bc89-405f0647f997 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:20 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 1073741824 Sep 17 15:11:20 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9d9aef4-692c-4b7b-829e-75bf293adb97 req-1a11bec3-2d6d-4ac0-9db5-e12f0ae2d176 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Flow 'volume_create_manager' (a2dfba8b-e5a6-41eb-bc10-673260780d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e7329-acf5-4dd6-93a4-26c0b805c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:20 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77e7329-acf5-4dd6-93a4-26c0b805c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d549b92-076a-415c-9be4-00faa820a51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec7b1d59bc84e84b13ac6d7d1d7c1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:21Z,use_quota=True,user_id='70d213722d8d4ee5af51c2830b991996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee67855-1631-49a1-9476-e612bb098e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aee67855-1631-49a1-9476-e612bb098e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f26274-7f2c-4923-8c6c-7e9f4fcb0178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f26274-7f2c-4923-8c6c-7e9f4fcb0178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d549b92-076a-415c-9be4-00faa820a51c', 'volume_name': 'volume-3d549b92-076a-415c-9be4-00faa820a51c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f55a2a5-06f6-4030-86d0-4cc0bc565505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f55a2a5-06f6-4030-86d0-4cc0bc565505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2874225-9fb5-4092-b5e5-41293a5d749c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Volume 3d549b92-076a-415c-9be4-00faa820a51c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d549b92-076a-415c-9be4-00faa820a51c', 'volume_size': 1} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 1073741824" returned: 0 in 1.091s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Acquiring lock "cinder-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:21 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 Sep 17 15:11:21 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "cinder-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Acquiring lock "cinder-quobyte-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "cinder-quobyte-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[957a842f-3a89-4fd6-94e9-bc511f8590e3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:21 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] <== create_volume: return (1503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9d9aef4-692c-4b7b-829e-75bf293adb97 req-1a11bec3-2d6d-4ac0-9db5-e12f0ae2d176 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.420s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f2b5ca-ca5d-48eb-ae2b-cc63b6e5f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacac0ed-dbdc-42fb-bc89-405f0647f997', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbdffda-5948-4c58-8d6b-39fc6c9215b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c9d9aef4-692c-4b7b-829e-75bf293adb97 req-1a11bec3-2d6d-4ac0-9db5-e12f0ae2d176 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d549b92-076a-415c-9be4-00faa820a51c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec7b1d59bc84e84b13ac6d7d1d7c1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:21Z,use_quota=True,user_id='70d213722d8d4ee5af51c2830b991996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Creating volume 3d549b92-076a-415c-9be4-00faa820a51c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:21 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe Sep 17 15:11:21 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Volume volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 (eacac0ed-dbdc-42fb-bc89-405f0647f997): created successfully Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afbdffda-5948-4c58-8d6b-39fc6c9215b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Flow 'volume_create_manager' (9bd4de89-bbeb-4b02-96a8-3e4480aeb57a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:21 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c 1073741824 Sep 17 15:11:21 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-830cb879-1b0a-4545-ba25-ba9460d8cb30 tempest-TestMinimumBasicScenario-1255645682 None] Created volume successfully. Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c9d9aef4-692c-4b7b-829e-75bf293adb97 req-1a11bec3-2d6d-4ac0-9db5-e12f0ae2d176 tempest-TestInstancesWithCinderVolumes-849510081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-c9a87f92-0dbe-4720-a8cb-619d41819480', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd86b3a09-8154-49d1-ade4-e5c8e7c44c9a', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:11:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c9d9aef4-692c-4b7b-829e-75bf293adb97 req-1a11bec3-2d6d-4ac0-9db5-e12f0ae2d176 tempest-TestInstancesWithCinderVolumes-849510081 None] attachment_update completed successfully. Sep 17 15:11:21 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:21 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe Sep 17 15:11:21 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:22 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c 1073741824" returned: 0 in 0.993s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:22 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" returned: 0 in 0.680s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "cinder-quobyte-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe" released by "delete_volume" :: held 1.325s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:22 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c Sep 17 15:11:22 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Created reservations ['170a3e7d-b1f9-40c4-9dfc-9d6e26f62b22', 'c36a1f84-1eb3-449a-a868-7d7240d97c16', '2cee28ff-dc20-48e1-9f9a-206f8f886dfb', '865629d9-fdac-4c02-8f16-cddb220620a2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:23 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:23 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:23 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2874225-9fb5-4092-b5e5-41293a5d749c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d549b92-076a-415c-9be4-00faa820a51c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6200e61-c632-482f-b697-23fed3082164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Volume volume-3d549b92-076a-415c-9be4-00faa820a51c (3d549b92-076a-415c-9be4-00faa820a51c): created successfully Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6200e61-c632-482f-b697-23fed3082164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Flow 'volume_create_manager' (a2dfba8b-e5a6-41eb-bc10-673260780d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0757f0ad-6c7f-47ce-8c5a-07b556066fdf tempest-CinderUnicodeTest-918502403 None] Created volume successfully. Sep 17 15:11:23 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Deleted volume successfully. Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb4ab031-1fe0-4bdf-9c70-d534672c257a tempest-VolumeImageDependencyTests-427866895 None] Lock "cinder-6ed641ee-31ae-4ed5-9f59-41e0d850b9fe-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-7d612265-f317-43ac-9084-cf7d043deec3 req-3dde2c17-9dd5-420d-892c-5ef4b079be89 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-7d612265-f317-43ac-9084-cf7d043deec3 req-3dde2c17-9dd5-420d-892c-5ef4b079be89 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-7d612265-f317-43ac-9084-cf7d043deec3 req-3dde2c17-9dd5-420d-892c-5ef4b079be89 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-7d612265-f317-43ac-9084-cf7d043deec3 req-3dde2c17-9dd5-420d-892c-5ef4b079be89 tempest-TestMinimumBasicScenario-1255645682 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-eacac0ed-dbdc-42fb-bc89-405f0647f997', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2ef4ecb-8825-4c6e-938c-d2e322064cc6', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:11:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-7d612265-f317-43ac-9084-cf7d043deec3 req-3dde2c17-9dd5-420d-892c-5ef4b079be89 tempest-TestMinimumBasicScenario-1255645682 None] attachment_update completed successfully. Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Flow 'volume_create_manager' (eb5f65bb-e07d-450f-a420-73631d139774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1b2b1-7103-404f-b28b-b626671e122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa1b2b1-7103-404f-b28b-b626671e122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1009934281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260fec95-9377-4ae0-bfb7-ca99d5e45b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec7b1d59bc84e84b13ac6d7d1d7c1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:26Z,use_quota=True,user_id='70d213722d8d4ee5af51c2830b991996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4110cd-0b84-4204-9ca7-5c7f23c5ac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4110cd-0b84-4204-9ca7-5c7f23c5ac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e3ba0-c30d-49c0-bdc0-deda621ed746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (026e3ba0-c30d-49c0-bdc0-deda621ed746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260fec95-9377-4ae0-bfb7-ca99d5e45b9b', 'volume_name': 'volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acfa528-13c9-426b-8b8f-213decb2cb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3acfa528-13c9-426b-8b8f-213decb2cb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c56d1-a0cd-4321-845a-b97fad07fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Volume 260fec95-9377-4ae0-bfb7-ca99d5e45b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b', 'volume_size': 1} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1009934281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260fec95-9377-4ae0-bfb7-ca99d5e45b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec7b1d59bc84e84b13ac6d7d1d7c1e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:26Z,use_quota=True,user_id='70d213722d8d4ee5af51c2830b991996',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Creating volume 260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:26 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b 1073741824 Sep 17 15:11:26 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:27 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b 1073741824" returned: 0 in 0.807s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:27 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b Sep 17 15:11:27 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:28 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" returned: 0 in 0.770s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8c56d1-a0cd-4321-845a-b97fad07fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e283dc22-4b0b-4838-be48-248693851bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Volume volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b (260fec95-9377-4ae0-bfb7-ca99d5e45b9b): created successfully Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e283dc22-4b0b-4838-be48-248693851bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Flow 'volume_create_manager' (eb5f65bb-e07d-450f-a420-73631d139774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d32eeb2b-c536-410a-82ad-64a44daa740d tempest-CinderUnicodeTest-918502403 None] Created volume successfully. Sep 17 15:11:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Creating offline snapshot d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 of volume 260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:11:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a701b89-8967-4152-be39-3290d15eb42c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:30 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b Sep 17 15:11:30 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:30 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" returned: 0 in 0.745s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:30 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 1G Sep 17 15:11:30 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:31 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 1G" returned: 0 in 0.708s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:31 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 Sep 17 15:11:31 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:31 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" returned: 0 in 0.624s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 is being set with open permissions: ugo+rw Sep 17 15:11:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:32 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 Sep 17 15:11:32 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:32 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" returned: 0 in 0.410s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:32 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info Sep 17 15:11:32 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:32 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:32 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info is being set with open permissions: ugo+rw Sep 17 15:11:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:32 devstack sudo[100109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info Sep 17 15:11:32 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:33 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.info" returned: 0 in 0.525s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.630s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7a979166-830b-4f02-b955-f2f8862b252f tempest-CinderUnicodeTest-918502403 None] Create snapshot completed successfully Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-quobyte-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Deleting offline snapshot d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 of volume 260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] snapshot_file for this snap is: volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a72a2ae-1435-49b4-9746-ecc39c5b5511]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:34 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 Sep 17 15:11:34 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:35 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" returned: 0 in 0.849s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:11:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[415842a7-2b07-49c5-9f80-bce9d64172ed]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:35 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b Sep 17 15:11:35 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:36 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" returned: 0 in 0.644s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:36 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 Sep 17 15:11:36 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:36 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" returned: 0 in 0.559s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:36 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4 Sep 17 15:11:36 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:37 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b.d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4" released by "_delete_snapshot" :: held 2.599s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" released by "delete_snapshot" :: held 2.645s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Created reservations ['9514e717-28b4-45ff-921a-523a877e57db', 'ddf0219a-c545-4924-b4b1-d185b76d41ca', 'd2edfb9d-7590-4311-a585-749edc74cad4', '35855a63-04b3-4e34-89e9-aa23f0e54bfd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:37 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Delete snapshot completed successfully. Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-67336674-1e47-4bf5-ab6d-1f576ac13f9a tempest-CinderUnicodeTest-918502403 None] Lock "cinder-d55083b3-b1f1-4bef-bee5-7cf0da3ef4d4-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-260fec95-9377-4ae0-bfb7-ca99d5e45b9b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "cinder-260fec95-9377-4ae0-bfb7-ca99d5e45b9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[70337a2e-239d-44fd-ad10-afe1ed5b999e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b Sep 17 15:11:38 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:38 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" returned: 0 in 0.492s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:38 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b Sep 17 15:11:38 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:39 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" returned: 0 in 0.565s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-260fec95-9377-4ae0-bfb7-ca99d5e45b9b" released by "delete_volume" :: held 1.200s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Created reservations ['7a970609-bb2d-43c6-bec3-db8bbf2476e3', '95a4c042-0583-4671-8f1d-3ac8e66ec561', 'c73f62ea-588e-47d7-8655-456091af28ef', '512c25ea-d5bd-413e-939d-97818eee7ce6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:39 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:39 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:40 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.628s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Deleted volume successfully. Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e94417b5-1cb9-4b23-93cb-8bc722694a33 tempest-CinderUnicodeTest-918502403 None] Lock "cinder-260fec95-9377-4ae0-bfb7-ca99d5e45b9b-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-3d549b92-076a-415c-9be4-00faa820a51c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "cinder-3d549b92-076a-415c-9be4-00faa820a51c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Acquiring lock "cinder-quobyte-3d549b92-076a-415c-9be4-00faa820a51c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-3d549b92-076a-415c-9be4-00faa820a51c" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be8d1af-d242-4480-ab9a-14e33aac71a9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:40 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c Sep 17 15:11:40 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:41 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c" returned: 0 in 0.627s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:41 devstack sudo[100152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c Sep 17 15:11:41 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:41 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3d549b92-076a-415c-9be4-00faa820a51c" returned: 0 in 0.466s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "cinder-quobyte-3d549b92-076a-415c-9be4-00faa820a51c" released by "delete_volume" :: held 1.210s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Created reservations ['32779853-b50b-4007-a728-f9f0ceeacf81', '36f54fad-880c-4ca8-9bd4-c151bfcd036e', '18d3f2e9-509a-4d8e-ae65-67579f08155e', '772785c1-f33c-446a-ac07-ffe003c56af3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:42 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:42 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:42 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.482s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:42 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Deleted volume successfully. Sep 17 15:11:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-bdd4565b-c31f-4d9f-92de-7303e3dc8dbc tempest-CinderUnicodeTest-918502403 None] Lock "cinder-3d549b92-076a-415c-9be4-00faa820a51c-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Flow 'volume_create_manager' (1b525e36-f235-4ea5-b13e-2a00df4ddac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fab3d3-3b29-4cfd-916d-324aba03637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fab3d3-3b29-4cfd-916d-324aba03637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930397658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f615d5fb-8d8a-44da-90ff-84271507dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c235cefb7ce4499ae8c97c5e0390964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:48Z,use_quota=True,user_id='cb680484806d4387a1b4649bbdb7d1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4578cd5-933d-4418-a6f9-08f517b0ae64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4578cd5-933d-4418-a6f9-08f517b0ae64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e723a6-4ca5-43e7-bb40-065c0910d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e723a6-4ca5-43e7-bb40-065c0910d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f615d5fb-8d8a-44da-90ff-84271507dde1', 'volume_name': 'volume-f615d5fb-8d8a-44da-90ff-84271507dde1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55154cc-ad32-49ad-a836-d3a0f63cf813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55154cc-ad32-49ad-a836-d3a0f63cf813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3fed4-5753-4055-84b1-b0a8c3bbdb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Volume f615d5fb-8d8a-44da-90ff-84271507dde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f615d5fb-8d8a-44da-90ff-84271507dde1', 'volume_size': 1} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-930397658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f615d5fb-8d8a-44da-90ff-84271507dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c235cefb7ce4499ae8c97c5e0390964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:48Z,use_quota=True,user_id='cb680484806d4387a1b4649bbdb7d1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Creating volume f615d5fb-8d8a-44da-90ff-84271507dde1 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:47 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:47 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 1073741824 Sep 17 15:11:47 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:48 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 1073741824" returned: 0 in 0.483s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:48 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 Sep 17 15:11:48 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:48 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80f3fed4-5753-4055-84b1-b0a8c3bbdb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f615d5fb-8d8a-44da-90ff-84271507dde1', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5125444d-8fdc-46db-808b-533018d64945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:48 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Volume volume-f615d5fb-8d8a-44da-90ff-84271507dde1 (f615d5fb-8d8a-44da-90ff-84271507dde1): created successfully Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5125444d-8fdc-46db-808b-533018d64945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:48 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Flow 'volume_create_manager' (1b525e36-f235-4ea5-b13e-2a00df4ddac0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-01dc33cf-a6b4-483c-823d-e5598015435a tempest-ProjectReaderTests-479143066 None] Created volume successfully. Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Acquiring lock "cinder-f615d5fb-8d8a-44da-90ff-84271507dde1-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "cinder-f615d5fb-8d8a-44da-90ff-84271507dde1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Acquiring lock "cinder-quobyte-f615d5fb-8d8a-44da-90ff-84271507dde1" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "cinder-quobyte-f615d5fb-8d8a-44da-90ff-84271507dde1" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab7185f-abdb-4ce6-afb3-6b6064c1c4db]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:50 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 Sep 17 15:11:50 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:50 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:50 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1 Sep 17 15:11:50 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:50 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f615d5fb-8d8a-44da-90ff-84271507dde1" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "cinder-quobyte-f615d5fb-8d8a-44da-90ff-84271507dde1" released by "delete_volume" :: held 0.714s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Created reservations ['2c43aaec-4283-4183-8a7f-799cb3679b23', 'fa46dabf-431b-4d98-82dd-5cf5eed141bb', 'feed68ae-474b-4183-96b5-78e66e1461a8', '4dcb25d4-643d-4b15-9760-b9ac51ad2053'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:50 devstack sudo[100277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:50 devstack sudo[100277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:51 devstack sudo[100277]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Deleted volume successfully. Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-560e464c-b9fa-4f3c-94bd-b02b5cb171bb tempest-ProjectReaderTests-479143066 None] Lock "cinder-f615d5fb-8d8a-44da-90ff-84271507dde1-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Flow 'volume_create_manager' (ebd64c09-cea4-483d-92bc-43fbf165f15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0e7dc9-4dd4-4774-81c4-4630ce42bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0e7dc9-4dd4-4774-81c4-4630ce42bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526019973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f25c36-1be3-411e-85fa-60bb717135f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c235cefb7ce4499ae8c97c5e0390964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:52Z,use_quota=True,user_id='cb680484806d4387a1b4649bbdb7d1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752c5a1f-12e2-4476-a890-ede41a8bcf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752c5a1f-12e2-4476-a890-ede41a8bcf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6455a8d-7813-4840-a580-d6b7cdcad152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6455a8d-7813-4840-a580-d6b7cdcad152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f25c36-1be3-411e-85fa-60bb717135f3', 'volume_name': 'volume-43f25c36-1be3-411e-85fa-60bb717135f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a21cdb3-f46b-4595-b38a-487fae75b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a21cdb3-f46b-4595-b38a-487fae75b21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71bd7d5-c38c-4809-bd72-a6bb67d428f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:51 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Volume 43f25c36-1be3-411e-85fa-60bb717135f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f25c36-1be3-411e-85fa-60bb717135f3', 'volume_size': 1} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526019973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f25c36-1be3-411e-85fa-60bb717135f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c235cefb7ce4499ae8c97c5e0390964',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:11:52Z,use_quota=True,user_id='cb680484806d4387a1b4649bbdb7d1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Creating volume 43f25c36-1be3-411e-85fa-60bb717135f3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:11:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:11:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:51 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 1073741824 Sep 17 15:11:51 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:52 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 1073741824" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=113,cinder:UPDATE=156,cinder:DELETE=14,cinder:INSERT=49 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:52 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 Sep 17 15:11:52 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:52 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71bd7d5-c38c-4809-bd72-a6bb67d428f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f25c36-1be3-411e-85fa-60bb717135f3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce60d3e3-837d-4bb7-bfe6-d6858ac30771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:11:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Volume volume-43f25c36-1be3-411e-85fa-60bb717135f3 (43f25c36-1be3-411e-85fa-60bb717135f3): created successfully Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce60d3e3-837d-4bb7-bfe6-d6858ac30771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Flow 'volume_create_manager' (ebd64c09-cea4-483d-92bc-43fbf165f15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:11:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a594b947-433b-461a-9078-a2f91b48b331 tempest-ProjectReaderTests-479143066 None] Created volume successfully. Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Acquiring lock "cinder-43f25c36-1be3-411e-85fa-60bb717135f3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "cinder-43f25c36-1be3-411e-85fa-60bb717135f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Acquiring lock "cinder-quobyte-43f25c36-1be3-411e-85fa-60bb717135f3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "cinder-quobyte-43f25c36-1be3-411e-85fa-60bb717135f3" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bdd521-d746-4d56-9026-3da594c08295]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:11:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:53 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 Sep 17 15:11:53 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:53 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:53 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3 Sep 17 15:11:53 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:53 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-43f25c36-1be3-411e-85fa-60bb717135f3" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "cinder-quobyte-43f25c36-1be3-411e-85fa-60bb717135f3" released by "delete_volume" :: held 0.667s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Created reservations ['c45f67fd-28b1-4ad4-bd8b-b6461d179617', '7643c3a1-532a-4554-a6c1-2892d8b42603', '6ffb0267-91c4-4362-9995-74c691675f30', 'b8483506-830b-41dd-b7f7-2067a6ed1401'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:53 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:53 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:53 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:53 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Deleted volume successfully. Sep 17 15:11:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6b774177-cf4c-4aa9-bebe-1582d84559fb tempest-ProjectReaderTests-479143066 None] Lock "cinder-43f25c36-1be3-411e-85fa-60bb717135f3-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:11:57 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:11:57 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:11:57 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-552e37b8-fa25-4939-a17a-3afc1143bdef req-83f65d34-9797-4bf0-b4de-75c1d3e03c49 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-552e37b8-fa25-4939-a17a-3afc1143bdef req-83f65d34-9797-4bf0-b4de-75c1d3e03c49 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-552e37b8-fa25-4939-a17a-3afc1143bdef req-83f65d34-9797-4bf0-b4de-75c1d3e03c49 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:11:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-552e37b8-fa25-4939-a17a-3afc1143bdef req-83f65d34-9797-4bf0-b4de-75c1d3e03c49 tempest-TestInstancesWithCinderVolumes-849510081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-063d8e58-8849-46e8-80c7-9eac0953818c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '865d064a-4d5f-48b7-aa55-25392749c768', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:11:58 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-552e37b8-fa25-4939-a17a-3afc1143bdef req-83f65d34-9797-4bf0-b4de-75c1d3e03c49 tempest-TestInstancesWithCinderVolumes-849510081 None] attachment_update completed successfully. Sep 17 15:12:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e53082b2-6d1d-4794-8eac-622493e7855a req-a54ff2de-931c-4aca-8ce8-caa409e02ce0 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e53082b2-6d1d-4794-8eac-622493e7855a req-a54ff2de-931c-4aca-8ce8-caa409e02ce0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e53082b2-6d1d-4794-8eac-622493e7855a req-a54ff2de-931c-4aca-8ce8-caa409e02ce0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:01 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e53082b2-6d1d-4794-8eac-622493e7855a req-a54ff2de-931c-4aca-8ce8-caa409e02ce0 tempest-TestInstancesWithCinderVolumes-849510081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-78113cc0-33c2-4757-83eb-2ab6141be61a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a6c1f43-a755-40e3-8380-51046413c795', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:12:01 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e53082b2-6d1d-4794-8eac-622493e7855a req-a54ff2de-931c-4aca-8ce8-caa409e02ce0 tempest-TestInstancesWithCinderVolumes-849510081 None] attachment_update completed successfully. Sep 17 15:12:07 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=121,cinder:INSERT=28,cinder:UPDATE=105,cinder:DELETE=10 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:12:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-81a4e24f-d872-4e5f-a64c-7e2d788f5dcd req-2a2a3f44-4f3c-4c61-9cf4-9a4799d8da5a tempest-TestInstancesWithCinderVolumes-849510081 None] Terminate volume connection completed successfully. Sep 17 15:12:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-81a4e24f-d872-4e5f-a64c-7e2d788f5dcd req-2a2a3f44-4f3c-4c61-9cf4-9a4799d8da5a tempest-TestInstancesWithCinderVolumes-849510081 None] Deleting attachment 865d064a-4d5f-48b7-aa55-25392749c768. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-063d8e58-8849-46e8-80c7-9eac0953818c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-063d8e58-8849-46e8-80c7-9eac0953818c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-quobyte-063d8e58-8849-46e8-80c7-9eac0953818c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-063d8e58-8849-46e8-80c7-9eac0953818c" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3022836-604c-453b-827e-1a836ed0a546]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:08 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c Sep 17 15:12:08 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:08 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:08 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c Sep 17 15:12:08 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:09 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-063d8e58-8849-46e8-80c7-9eac0953818c" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-063d8e58-8849-46e8-80c7-9eac0953818c" released by "delete_volume" :: held 0.803s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:09 devstack cinder-volume[85963]: WARNING cinder.quota [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1824867375-2069749504 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1824867375-2069749504, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:09 devstack cinder-volume[85963]: WARNING cinder.quota [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1824867375-2069749504 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1824867375-2069749504, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Created reservations ['dc97a851-1e8e-4b0c-8583-66e43b2f7cc6', '1ccb3e0c-b169-4fbf-95b1-64e915e1ed62', '1a45f9cc-f957-43db-9859-b2aba619eb54', 'e1ec25d7-6d5c-47da-b9c7-dddf9a882376'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:09 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:09 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:09 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Deleted volume successfully. Sep 17 15:12:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-81f4a87c-babb-4e15-b82c-84ef4f62cfd7 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-063d8e58-8849-46e8-80c7-9eac0953818c-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-5d72c80f-15ed-4189-953b-460a5d799488 req-be633032-054f-43a9-9093-7f62d84d3402 tempest-TestInstancesWithCinderVolumes-849510081 None] Terminate volume connection completed successfully. Sep 17 15:12:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-5d72c80f-15ed-4189-953b-460a5d799488 req-be633032-054f-43a9-9093-7f62d84d3402 tempest-TestInstancesWithCinderVolumes-849510081 None] Deleting attachment 3a6c1f43-a755-40e3-8380-51046413c795. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-78113cc0-33c2-4757-83eb-2ab6141be61a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-78113cc0-33c2-4757-83eb-2ab6141be61a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-quobyte-78113cc0-33c2-4757-83eb-2ab6141be61a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-78113cc0-33c2-4757-83eb-2ab6141be61a" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dd7deb-a291-4ed3-aeeb-a74d4b5c22b2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-3f89d5a0-7422-4014-8d43-dc79823b628c req-f0d833f4-2abb-4387-9115-a20e30b3b8e6 tempest-TestMinimumBasicScenario-1255645682 None] Terminate volume connection completed successfully. Sep 17 15:12:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3f89d5a0-7422-4014-8d43-dc79823b628c req-f0d833f4-2abb-4387-9115-a20e30b3b8e6 tempest-TestMinimumBasicScenario-1255645682 None] Deleting attachment b2ef4ecb-8825-4c6e-938c-d2e322064cc6. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:12:13 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a Sep 17 15:12:13 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a" returned: 0 in 0.725s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:14 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a Sep 17 15:12:14 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "cinder-eacac0ed-dbdc-42fb-bc89-405f0647f997-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "cinder-eacac0ed-dbdc-42fb-bc89-405f0647f997-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:14 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-78113cc0-33c2-4757-83eb-2ab6141be61a" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "cinder-quobyte-eacac0ed-dbdc-42fb-bc89-405f0647f997" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-78113cc0-33c2-4757-83eb-2ab6141be61a" released by "delete_volume" :: held 1.264s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "cinder-quobyte-eacac0ed-dbdc-42fb-bc89-405f0647f997" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:14 devstack cinder-volume[85963]: WARNING cinder.quota [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-406950626-1450621623 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-406950626-1450621623, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:14 devstack cinder-volume[85963]: WARNING cinder.quota [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-406950626-1450621623 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-406950626-1450621623, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff12a036-ee53-45b4-aca1-7a235feab02a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Created reservations ['7bebffb7-a0e8-4dcd-94ab-a5416eb32dfa', 'bb0d607d-c9bc-4299-bb7d-891379b3af90', 'c9621fac-8b22-457b-8dce-8906e3084cda', '4b58ff90-8b94-4047-b06f-38a8a603c180'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:14 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 Sep 17 15:12:14 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:15 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:15 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997" returned: 0 in 0.602s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.421s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Deleted volume successfully. Sep 17 15:12:15 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997 Sep 17 15:12:15 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-cb32aabc-d177-4702-8248-632d2a468ac0 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-78113cc0-33c2-4757-83eb-2ab6141be61a-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:15 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-eacac0ed-dbdc-42fb-bc89-405f0647f997" returned: 0 in 0.341s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "cinder-quobyte-eacac0ed-dbdc-42fb-bc89-405f0647f997" released by "delete_volume" :: held 1.019s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Created reservations ['e406a872-dd8b-44df-b98b-8d4234f10abe', '36db84aa-2da4-4a9b-8d13-189b1573f082', 'f7b3f7d7-b838-4cab-9d7f-47bbaa2ee7df', '2e556b02-8ccc-4161-b61d-08d0c21efdd5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:15 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:15 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:16 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Deleted volume successfully. Sep 17 15:12:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f0191331-fa1e-4404-8396-3288a87df1c3 tempest-TestMinimumBasicScenario-1255645682 None] Lock "cinder-eacac0ed-dbdc-42fb-bc89-405f0647f997-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Flow 'volume_create_manager' (2ff34bb0-afa7-408c-8000-8688aa98e4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68839cf-bdc7-4f31-9b4a-55e958aa9251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68839cf-bdc7-4f31-9b4a-55e958aa9251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-838235029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57eeda7c-2e43-4780-ab33-6c5c2c0c2f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f82a1125354b28ac7807e5fd074b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:19Z,use_quota=True,user_id='38cf857f11344e5fb6936acbbcf45bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b2ba76-da1c-4c85-acdd-e0077326e0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b2ba76-da1c-4c85-acdd-e0077326e0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5880d7f8-6b0e-4d3e-bf95-3f441eddbc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5880d7f8-6b0e-4d3e-bf95-3f441eddbc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57eeda7c-2e43-4780-ab33-6c5c2c0c2f53', 'volume_name': 'volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9917e533-d109-42d6-9630-14df98f181f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9917e533-d109-42d6-9630-14df98f181f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1e8cb9-8cc0-4313-bea4-fd6dcd153b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Volume 57eeda7c-2e43-4780-ab33-6c5c2c0c2f53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53', 'volume_size': 1} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-838235029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57eeda7c-2e43-4780-ab33-6c5c2c0c2f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f82a1125354b28ac7807e5fd074b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:19Z,use_quota=True,user_id='38cf857f11344e5fb6936acbbcf45bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Creating volume 57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:12:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:19 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 1073741824 Sep 17 15:12:19 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:20 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 1073741824" returned: 0 in 0.803s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:20 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:20 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:20 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1e8cb9-8cc0-4313-bea4-fd6dcd153b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb88769e-bb9d-4a5f-8ca5-ba19f9c30e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Volume volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 (57eeda7c-2e43-4780-ab33-6c5c2c0c2f53): created successfully Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb88769e-bb9d-4a5f-8ca5-ba19f9c30e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Flow 'volume_create_manager' (2ff34bb0-afa7-408c-8000-8688aa98e4be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-517d6b16-8d31-477c-9dd8-95b15a8aca5b tempest-SnapshotDependencyTests-668522679 None] Created volume successfully. Sep 17 15:12:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-751742af-df64-4b65-864d-11eb42f8ea49 req-e7f0f0c9-3a05-42bf-a195-cb8c5ada2ca7 tempest-TestInstancesWithCinderVolumes-849510081 None] Terminate volume connection completed successfully. Sep 17 15:12:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-751742af-df64-4b65-864d-11eb42f8ea49 req-e7f0f0c9-3a05-42bf-a195-cb8c5ada2ca7 tempest-TestInstancesWithCinderVolumes-849510081 None] Deleting attachment d86b3a09-8154-49d1-ade4-e5c8e7c44c9a. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Creating offline snapshot fe284499-ac93-4259-9717-332758f2ee94 of volume 57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6795f60-01d9-478c-9636-848fff509dcb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:22 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:22 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-c9a87f92-0dbe-4720-a8cb-619d41819480-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-c9a87f92-0dbe-4720-a8cb-619d41819480-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "cinder-quobyte-c9a87f92-0dbe-4720-a8cb-619d41819480" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-c9a87f92-0dbe-4720-a8cb-619d41819480" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:22 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4c9f0-7647-4f37-830c-64230ea4eab4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:22 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 1G Sep 17 15:12:22 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:22 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 Sep 17 15:12:22 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:22 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:22 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480 Sep 17 15:12:22 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:22 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 1G" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:22 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:22 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:23 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c9a87f92-0dbe-4720-a8cb-619d41819480" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-quobyte-c9a87f92-0dbe-4720-a8cb-619d41819480" released by "delete_volume" :: held 0.741s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:23 devstack cinder-volume[85963]: WARNING cinder.quota [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566041118-1468328534 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566041118-1468328534, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:23 devstack cinder-volume[85963]: WARNING cinder.quota [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566041118-1468328534 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-566041118-1468328534, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Created reservations ['a372bbed-b9a3-4bef-be22-411c2b51f918', 'c79d597a-3729-46d5-8de2-b733e54d18b8', '14edf530-12cd-4af8-a1cd-dc8078f34922', '1f7f881e-a6d8-4683-ba7e-b322e712370c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:23 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 is being set with open permissions: ugo+rw Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:23 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:23 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:23 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:23 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:23 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.308s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:23 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info Sep 17 15:12:23 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:23 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Deleted volume successfully. Sep 17 15:12:23 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b3a07a2e-a8bf-470b-ac86-1963849fada5 tempest-TestInstancesWithCinderVolumes-849510081 None] Lock "cinder-c9a87f92-0dbe-4720-a8cb-619d41819480-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:24 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:24 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info is being set with open permissions: ugo+rw Sep 17 15:12:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:24 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info Sep 17 15:12:24 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:24 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.info" returned: 0 in 0.342s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.375s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b2607edc-3ada-467a-a38a-64b0ae72bc43 tempest-SnapshotDependencyTests-668522679 None] Create snapshot completed successfully Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Flow 'volume_create_manager' (27d013f4-4496-465e-8b6f-9e769e3c5cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d277c02-7ea9-4c59-a7a4-c9b4a9ef1ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d277c02-7ea9-4c59-a7a4-c9b4a9ef1ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0ae852-ab2a-424a-b42b-969578e67d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71f82a1125354b28ac7807e5fd074b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe284499-ac93-4259-9717-332758f2ee94,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:12:26Z,use_quota=True,user_id='38cf857f11344e5fb6936acbbcf45bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de35dfbc-2ae7-491d-ab84-73610e8b043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de35dfbc-2ae7-491d-ab84-73610e8b043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03373c25-1217-4f9f-b96e-e8e42fb9c996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03373c25-1217-4f9f-b96e-e8e42fb9c996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d0ae852-ab2a-424a-b42b-969578e67d16', 'volume_name': 'volume-9d0ae852-ab2a-424a-b42b-969578e67d16', 'volume_size': 1, 'snapshot_id': 'fe284499-ac93-4259-9717-332758f2ee94'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500851e3-04fa-47dd-a73b-66364a4f2198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500851e3-04fa-47dd-a73b-66364a4f2198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac944db-156a-4f95-bdf8-95e0b76680f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Volume 9d0ae852-ab2a-424a-b42b-969578e67d16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d0ae852-ab2a-424a-b42b-969578e67d16', 'volume_size': 1, 'snapshot_id': 'fe284499-ac93-4259-9717-332758f2ee94'} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94-9d0ae852-ab2a-424a-b42b-969578e67d16" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94-9d0ae852-ab2a-424a-b42b-969578e67d16" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Creating volume 9d0ae852-ab2a-424a-b42b-969578e67d16 from snapshot fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] snapshot: fe284499-ac93-4259-9717-332758f2ee94, volume: 9d0ae852-ab2a-424a-b42b-969578e67d16, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[86748a45-33c5-426e-bea3-c832af0940c9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:26 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:26 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:26 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6a82d-f149-4f50-97b5-714852cfeadf]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:26 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:26 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:26 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:12:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:26 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 Sep 17 15:12:26 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:34 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16" returned: 0 in 7.813s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:34 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53, size 1024.00 MB, duration 7.82 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:12:34 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Converted 1024.00 MB image at 131.02 MB/s Sep 17 15:12:34 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 is being set with open permissions: ugo+rw Sep 17 15:12:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:34 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 Sep 17 15:12:34 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:34 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" released by "_copy_volume_from_snapshot" :: held 9.015s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94-9d0ae852-ab2a-424a-b42b-969578e67d16" released by "_create_volume_from_snapshot" :: held 9.088s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.109s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac944db-156a-4f95-bdf8-95e0b76680f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0ae852-ab2a-424a-b42b-969578e67d16', 'volume_size': 1, 'snapshot_id': 'fe284499-ac93-4259-9717-332758f2ee94'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c8354d-3fb5-4251-ae06-c4907069efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:12:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Volume volume-9d0ae852-ab2a-424a-b42b-969578e67d16 (9d0ae852-ab2a-424a-b42b-969578e67d16): created successfully Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c8354d-3fb5-4251-ae06-c4907069efb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Flow 'volume_create_manager' (27d013f4-4496-465e-8b6f-9e769e3c5cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:12:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-13951f3b-03b4-4acf-9f15-4aa04b8cd658 tempest-SnapshotDependencyTests-668522679 None] Created volume successfully. Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-fe284499-ac93-4259-9717-332758f2ee94-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-fe284499-ac93-4259-9717-332758f2ee94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Deleting offline snapshot fe284499-ac93-4259-9717-332758f2ee94 of volume 57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] snapshot_file for this snap is: volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe91ae-e923-42e6-ae80-217a2d85801d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:36 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:36 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:36 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.396s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:12:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f0ea6-9230-425d-a185-535b6b7b48d0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:36 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:36 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:37 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.647s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:37 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:37 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:37 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:37 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94 Sep 17 15:12:37 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:37 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53.fe284499-ac93-4259-9717-332758f2ee94" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-fe284499-ac93-4259-9717-332758f2ee94" released by "_delete_snapshot" :: held 1.923s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" released by "delete_snapshot" :: held 1.946s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Created reservations ['6a859382-3c11-409e-a0eb-85fb932b44f5', 'a168c0de-d668-4c66-9e7f-0b9d84ccd334', 'a33748c8-be19-490d-a3a5-1e9cf12376a0', 'bcee6039-9c40-4e50-8c72-c2f96aaa0548'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Delete snapshot completed successfully. Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e001cbae-949c-4fc9-945c-2e574d08a74f tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-fe284499-ac93-4259-9717-332758f2ee94-delete_snapshot" released by "delete_snapshot" :: held 2.154s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de77d3-7abc-4392-a37d-39ef1989881f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:38 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:38 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:38 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.437s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:38 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53 Sep 17 15:12:38 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:38 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53" released by "delete_volume" :: held 0.826s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Created reservations ['70a79680-b845-4a0d-bd08-4258420803d8', '7c38e8a8-4dfa-4ebd-970a-2fb327a9de48', '43af3809-aca1-441f-bff3-895e1561fc58', '972289c6-b2b5-4e8c-bb29-3d30343e62a9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:39 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-9d0ae852-ab2a-424a-b42b-969578e67d16-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-9d0ae852-ab2a-424a-b42b-969578e67d16-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c09c94-5f75-4542-9945-7011a65b9a40]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:39 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 Sep 17 15:12:39 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Deleted volume successfully. Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-967f0923-f8e5-49e7-b1ed-13f6dba4d656 tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-57eeda7c-2e43-4780-ab33-6c5c2c0c2f53-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:39 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16" returned: 0 in 0.474s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:39 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16 Sep 17 15:12:39 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:40 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9d0ae852-ab2a-424a-b42b-969578e67d16" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-quobyte-9d0ae852-ab2a-424a-b42b-969578e67d16" released by "delete_volume" :: held 0.827s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Created reservations ['387d3049-def0-4f4d-be01-612dfb6bb5ec', 'b0a955bd-cf0f-4ab1-8810-52670c646407', '19e06400-e986-4f6d-8efa-6936d409e5d5', '9e0690a1-71b4-47d7-8db3-2fce9765abca'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:40 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:40 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:40 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Deleted volume successfully. Sep 17 15:12:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f73b8cae-f150-4350-a469-4de01ecc5f4c tempest-SnapshotDependencyTests-668522679 None] Lock "cinder-9d0ae852-ab2a-424a-b42b-969578e67d16-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:12:50 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=44,cinder:UPDATE=60,cinder:INSERT=15,cinder:DELETE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:12:50 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=74,cinder:DELETE=7,cinder:SELECT=72,cinder:INSERT=19 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:12:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:12:57 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:12:57 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:12:57 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 17 15:12:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:12:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:12:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:12:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:12:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Flow 'volume_create_manager' (8d376042-5b7f-4e3b-bd6d-553021cab8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfd3579-5d71-4c05-8d49-c29afef83407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfd3579-5d71-4c05-8d49-c29afef83407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1017566636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6010613b-91ee-46c0-954c-ab7f5d4ec59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94cce010d2d40368374497bc2634905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:12Z,use_quota=True,user_id='a0cce12b3de24ec6b5298ab99cf26726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c748202a-d8b3-4613-bfb8-fd159af24ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c748202a-d8b3-4613-bfb8-fd159af24ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7addcf0-85bd-4225-9175-e9e9a0670fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7addcf0-85bd-4225-9175-e9e9a0670fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'volume_name': 'volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b8ebfe-68ca-4707-bf8c-3527a5f3344a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b8ebfe-68ca-4707-bf8c-3527a5f3344a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3131f5e-ac26-448f-9b00-2c3ba5b47c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 17 15:13:12 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Trying to clone 6010613b-91ee-46c0-954c-ab7f5d4ec59d from image 8d02878c-b12d-4421-bc53-544f1bf812dd at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:13:13 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Image download 20.69 MB at 20.69 MB/s Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c9b493-52df-43bb-9291-c128467afec3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:13 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD Sep 17 15:13:13 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:13 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd is fetched for user a0cce12b3de24ec6b5298ab99cf26726. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03a2ae3-61b7-4497-8738-46ea7c08477d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:13 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD Sep 17 15:13:13 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:13 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1017566636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6010613b-91ee-46c0-954c-ab7f5d4ec59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94cce010d2d40368374497bc2634905',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:12Z,use_quota=True,user_id='a0cce12b3de24ec6b5298ab99cf26726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Creating volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:14 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1073741824 Sep 17 15:13:14 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:14 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1073741824" returned: 0 in 0.502s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:14 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d Sep 17 15:13:14 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:14 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Attempting download of 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a49d8-ab6b-4289-b3a4-ced8c8386378]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:14 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf Sep 17 15:13:14 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:15 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf" returned: 0 in 0.336s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:15 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf Sep 17 15:13:15 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:15 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf" returned: 1 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d02878c-b12d-4421-bc53-544f1bf812dd_6i0azvbf' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a122b71-9b1e-4c48-aad7-f983616d724d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:15 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD Sep 17 15:13:15 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:15 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] 8d02878c-b12d-4421-bc53-544f1bf812dd was qcow2, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:13:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:15 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d Sep 17 15:13:15 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:18 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d" returned: 0 in 2.169s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d02878c-b12d-4421-bc53-544f1bf812dd_8_aejlebdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:13:18 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Converted 112.00 MB image at 51.58 MB/s Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:18 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1G Sep 17 15:13:18 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:18 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d 1G" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Downloaded image 8d02878c-b12d-4421-bc53-544f1bf812dd ((None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}])) to volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Temporary image 8d02878c-b12d-4421-bc53-544f1bf812dd for user a0cce12b3de24ec6b5298ab99cf26726 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Marking volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Copying metadata from image 8d02878c-b12d-4421-bc53-544f1bf812dd to 6010613b-91ee-46c0-954c-ab7f5d4ec59d. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Creating volume glance metadata for volume 6010613b-91ee-46c0-954c-ab7f5d4ec59d backed by image 8d02878c-b12d-4421-bc53-544f1bf812dd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3131f5e-ac26-448f-9b00-2c3ba5b47c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'volume_size': 1, 'image_id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d02878c-b12d-4421-bc53-544f1bf812dd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f994c671474b41dca617dd93fb704a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d02878c-b12d-4421-bc53-544f1bf812dd', 'created_at': datetime.datetime(2026, 9, 17, 12, 51, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 12, 51, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d02878c-b12d-4421-bc53-544f1bf812dd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a9fedd-ae0c-4a9c-86f9-fb550ee73acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Volume volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d (6010613b-91ee-46c0-954c-ab7f5d4ec59d): created successfully Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a9fedd-ae0c-4a9c-86f9-fb550ee73acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Flow 'volume_create_manager' (8d376042-5b7f-4e3b-bd6d-553021cab8a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1aa23a20-ed40-44a3-9b47-259ba6e4dc6a tempest-TestShelveInstance-1534958268 None] Created volume successfully. Sep 17 15:13:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e6d3d2f8-9423-4caa-9744-2a684b0aa0de req-468d620b-da6a-4f7d-acce-0e5eb3995f42 tempest-TestShelveInstance-1534958268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e6d3d2f8-9423-4caa-9744-2a684b0aa0de req-468d620b-da6a-4f7d-acce-0e5eb3995f42 tempest-TestShelveInstance-1534958268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-e6d3d2f8-9423-4caa-9744-2a684b0aa0de req-468d620b-da6a-4f7d-acce-0e5eb3995f42 tempest-TestShelveInstance-1534958268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e6d3d2f8-9423-4caa-9744-2a684b0aa0de req-468d620b-da6a-4f7d-acce-0e5eb3995f42 tempest-TestShelveInstance-1534958268 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c0e769d-d783-419d-8e70-b3cdad4dde16', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:13:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e6d3d2f8-9423-4caa-9744-2a684b0aa0de req-468d620b-da6a-4f7d-acce-0e5eb3995f42 tempest-TestShelveInstance-1534958268 None] attachment_update completed successfully. Sep 17 15:13:33 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:33 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=6,cinder:SELECT=18,cinder:INSERT=6 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Flow 'volume_create_manager' (5e955ffa-faa5-4afe-95a9-46f5ab7f6e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e38b1a-53ce-47f8-b3e3-9bd97b6d577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3e38b1a-53ce-47f8-b3e3-9bd97b6d577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1340898465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff41f62-bb42-481d-93df-8f39c299f07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2763d627cfe4235aaf6d291a1a9096a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:46Z,use_quota=True,user_id='4a47be3d5cbe410a9ba5d998dce4fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37031db9-a420-48f0-8fb7-289e9409e9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37031db9-a420-48f0-8fb7-289e9409e9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0428f5f-6ca3-429e-a404-c56fe0c719a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0428f5f-6ca3-429e-a404-c56fe0c719a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff41f62-bb42-481d-93df-8f39c299f07f', 'volume_name': 'volume-aff41f62-bb42-481d-93df-8f39c299f07f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e498c3-8ab3-4eb5-822e-8132113bb9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e498c3-8ab3-4eb5-822e-8132113bb9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c275aeb-498d-4429-81c1-f0e38b923861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Volume aff41f62-bb42-481d-93df-8f39c299f07f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff41f62-bb42-481d-93df-8f39c299f07f', 'volume_size': 1} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:13:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1340898465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff41f62-bb42-481d-93df-8f39c299f07f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2763d627cfe4235aaf6d291a1a9096a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:13:46Z,use_quota=True,user_id='4a47be3d5cbe410a9ba5d998dce4fee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Creating volume aff41f62-bb42-481d-93df-8f39c299f07f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:13:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:13:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:45 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f 1073741824 Sep 17 15:13:45 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:46 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f 1073741824" returned: 0 in 0.405s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:46 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f Sep 17 15:13:46 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:46 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c275aeb-498d-4429-81c1-f0e38b923861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff41f62-bb42-481d-93df-8f39c299f07f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b0ff47-817c-4674-ae52-8289a698225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:13:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Volume volume-aff41f62-bb42-481d-93df-8f39c299f07f (aff41f62-bb42-481d-93df-8f39c299f07f): created successfully Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b0ff47-817c-4674-ae52-8289a698225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:13:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Flow 'volume_create_manager' (5e955ffa-faa5-4afe-95a9-46f5ab7f6e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:13:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1e4d1cc9-25fd-4138-a55e-9175125df586 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Created volume successfully. Sep 17 15:13:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3e84ee44-e072-49a7-aa44-2e9e42f5e7d7 req-9e25fb99-f6aa-44bf-bf7d-778bdae56a43 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3e84ee44-e072-49a7-aa44-2e9e42f5e7d7 req-9e25fb99-f6aa-44bf-bf7d-778bdae56a43 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-3e84ee44-e072-49a7-aa44-2e9e42f5e7d7 req-9e25fb99-f6aa-44bf-bf7d-778bdae56a43 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-3e84ee44-e072-49a7-aa44-2e9e42f5e7d7 req-9e25fb99-f6aa-44bf-bf7d-778bdae56a43 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-aff41f62-bb42-481d-93df-8f39c299f07f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4093775c-5c6e-4cec-bff0-0e2bdfbf744b', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:13:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-3e84ee44-e072-49a7-aa44-2e9e42f5e7d7 req-9e25fb99-f6aa-44bf-bf7d-778bdae56a43 tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] attachment_update completed successfully. Sep 17 15:13:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-4454b45c-5730-47c9-b972-00adf782b94a req-a70e3956-2166-448b-8fd4-f7abf841dc1e tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Terminate volume connection completed successfully. Sep 17 15:13:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-4454b45c-5730-47c9-b972-00adf782b94a req-a70e3956-2166-448b-8fd4-f7abf841dc1e tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Deleting attachment 4093775c-5c6e-4cec-bff0-0e2bdfbf744b. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "cinder-aff41f62-bb42-481d-93df-8f39c299f07f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "cinder-aff41f62-bb42-481d-93df-8f39c299f07f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "cinder-quobyte-aff41f62-bb42-481d-93df-8f39c299f07f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "cinder-quobyte-aff41f62-bb42-481d-93df-8f39c299f07f" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[007eece6-a5a6-45d1-b8d3-d8989583f285]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:13:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:50 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f Sep 17 15:13:50 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:51 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:51 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f Sep 17 15:13:51 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:51 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aff41f62-bb42-481d-93df-8f39c299f07f" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "cinder-quobyte-aff41f62-bb42-481d-93df-8f39c299f07f" released by "delete_volume" :: held 0.721s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Created reservations ['6e6abb36-e90e-425b-a89d-efffb12c6fbb', 'a5efea9f-e43c-44bc-a5fd-8f9134f8efb0', '303c9db1-1a01-4efc-8990-d3c4a659503b', '843912dc-f5a9-4798-98d6-3ec6fb023d1c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:51 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:13:51 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:51 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Deleted volume successfully. Sep 17 15:13:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d75205e7-fe18-4c91-be64-7c944d3c8efb tempest-TestServerVolumeAttachScenarioOldVersion-314268281 None] Lock "cinder-aff41f62-bb42-481d-93df-8f39c299f07f-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:13:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:13:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:13:57 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:13:57 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:13:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-e6c4d9a5-903d-46cc-b535-ccc5c6434680 req-e8d0c17b-f771-481e-ae69-4af017d2b1fe tempest-TestShelveInstance-1534958268 None] Terminate volume connection completed successfully. Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-e6c4d9a5-903d-46cc-b535-ccc5c6434680 req-e8d0c17b-f771-481e-ae69-4af017d2b1fe tempest-TestShelveInstance-1534958268 None] Deleting attachment 6c0e769d-d783-419d-8e70-b3cdad4dde16. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:13:57 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:13:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:13:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-266154ef-9aac-4c7d-ac31-4657d2dfa895 req-1b78e0fa-530f-48d2-9789-3c311c1c2374 tempest-TestShelveInstance-1534958268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:13:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-266154ef-9aac-4c7d-ac31-4657d2dfa895 req-1b78e0fa-530f-48d2-9789-3c311c1c2374 tempest-TestShelveInstance-1534958268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:13:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-266154ef-9aac-4c7d-ac31-4657d2dfa895 req-1b78e0fa-530f-48d2-9789-3c311c1c2374 tempest-TestShelveInstance-1534958268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:13:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-266154ef-9aac-4c7d-ac31-4657d2dfa895 req-1b78e0fa-530f-48d2-9789-3c311c1c2374 tempest-TestShelveInstance-1534958268 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48', 'name': 'volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4674ae44-debf-4a39-9d62-3e2b674f6237', 'enforce_multipath': True} {{(pid=85963) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 17 15:13:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-266154ef-9aac-4c7d-ac31-4657d2dfa895 req-1b78e0fa-530f-48d2-9789-3c311c1c2374 tempest-TestShelveInstance-1534958268 None] attachment_update completed successfully. Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (b5a66008-8d59-4ce0-966c-295e18bd3cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07e94d0-4949-413b-b46e-863439d5cf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07e94d0-4949-413b-b46e-863439d5cf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351397270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6a5dbd-5601-4f1a-8108-31bdc9bb6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:09Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c182205-0901-411a-aa89-8ee4035195a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c182205-0901-411a-aa89-8ee4035195a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc8b3c2-d931-4f70-b222-a49b8f4175e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc8b3c2-d931-4f70-b222-a49b8f4175e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6a5dbd-5601-4f1a-8108-31bdc9bb6696', 'volume_name': 'volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a859053-dc35-407d-85c9-5bc66b28e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a859053-dc35-407d-85c9-5bc66b28e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783afdf5-8d23-4524-88de-a5c88909a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:09 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Volume 0a6a5dbd-5601-4f1a-8108-31bdc9bb6696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696', 'volume_size': 1} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-351397270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6a5dbd-5601-4f1a-8108-31bdc9bb6696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:09Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Creating volume 0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:09 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:09 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 1073741824 Sep 17 15:14:09 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:09 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (7fbb2ad3-91c0-45d2-857f-03464f3ce8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfecad34-6763-445b-b1fe-1f73f2fe9d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfecad34-6763-445b-b1fe-1f73f2fe9d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847893263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ec703-324c-4474-856b-a8d0e3eaa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:10Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd27c987-a1e2-41ab-bb1e-c16ed7e1743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd27c987-a1e2-41ab-bb1e-c16ed7e1743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f6b95-9937-4880-b476-01e6498c5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29f6b95-9937-4880-b476-01e6498c5635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e67ec703-324c-4474-856b-a8d0e3eaa641', 'volume_name': 'volume-e67ec703-324c-4474-856b-a8d0e3eaa641', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56179613-e802-43b3-a21c-57bb108774c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56179613-e802-43b3-a21c-57bb108774c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe51c1-354e-4611-a3b8-df19f5ed4e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Volume e67ec703-324c-4474-856b-a8d0e3eaa641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e67ec703-324c-4474-856b-a8d0e3eaa641', 'volume_size': 1} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:10 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 1073741824" returned: 0 in 0.528s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:10 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 Sep 17 15:14:10 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (5349efc0-b8b7-4dcb-92fa-3fae9d71d0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d863976-4c80-4e95-bfbf-d41b7c79f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d863976-4c80-4e95-bfbf-d41b7c79f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270483701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3b8f57-d2aa-4802-8aad-1c312351c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:10Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d3b01e-14cd-4769-a467-0c3880576b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96d3b01e-14cd-4769-a467-0c3880576b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec693cf0-a372-439b-9b36-1489a278422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec693cf0-a372-439b-9b36-1489a278422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff3b8f57-d2aa-4802-8aad-1c312351c427', 'volume_name': 'volume-ff3b8f57-d2aa-4802-8aad-1c312351c427', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6573d-f459-49a5-96a5-5f201399e380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa6573d-f459-49a5-96a5-5f201399e380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebccbbc-0ff7-49aa-8696-4ad84eef37b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Volume ff3b8f57-d2aa-4802-8aad-1c312351c427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff3b8f57-d2aa-4802-8aad-1c312351c427', 'volume_size': 1} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:10 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-847893263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e67ec703-324c-4474-856b-a8d0e3eaa641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:10Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Creating volume e67ec703-324c-4474-856b-a8d0e3eaa641 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:10 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 1073741824 Sep 17 15:14:10 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783afdf5-8d23-4524-88de-a5c88909a724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542b8974-99c1-42d0-92e5-d42e72dd1909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Volume volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 (0a6a5dbd-5601-4f1a-8108-31bdc9bb6696): created successfully Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542b8974-99c1-42d0-92e5-d42e72dd1909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (b5a66008-8d59-4ce0-966c-295e18bd3cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fe421a16-f1f3-471d-b91c-88658c12c2ba tempest-CreateVolumesFromImageTest-1246492414 None] Created volume successfully. Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (340363a1-373b-4102-a0cc-2ebcb3497783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93dc55a-5fc6-4914-95fc-0c26fbbee92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93dc55a-5fc6-4914-95fc-0c26fbbee92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633463922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2ad665-b7c2-4c75-a0a2-8d82eec798d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:11Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b635bbc-a236-4c56-a175-c8cb775dc887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b635bbc-a236-4c56-a175-c8cb775dc887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f761216-1a8b-4e10-92b5-3657b4dd85ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f761216-1a8b-4e10-92b5-3657b4dd85ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2ad665-b7c2-4c75-a0a2-8d82eec798d4', 'volume_name': 'volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1dca7-474a-4431-b1e4-308c84eebdbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efd1dca7-474a-4431-b1e4-308c84eebdbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82b5a81-6974-466e-98cc-14824a867ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:10 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Volume dc2ad665-b7c2-4c75-a0a2-8d82eec798d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4', 'volume_size': 1} Sep 17 15:14:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:11 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (1af4fa8d-c97a-4a4b-a66c-52a7b57bfe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2883306-7487-4412-8d6d-c76522a84976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 1073741824" returned: 0 in 0.723s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2883306-7487-4412-8d6d-c76522a84976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749278544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d53d02-2a3a-4dd4-a976-63ff97ddf652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:11Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87042a0-a2ee-4947-85c1-9e8569db4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d87042a0-a2ee-4947-85c1-9e8569db4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943c5a5a-444f-4ed1-9412-3325fbd77d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943c5a5a-444f-4ed1-9412-3325fbd77d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44d53d02-2a3a-4dd4-a976-63ff97ddf652', 'volume_name': 'volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6f2ad-e7f4-4cd8-86ef-90d9cbc679b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec6f2ad-e7f4-4cd8-86ef-90d9cbc679b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a4cde-f5e1-413c-9edb-45b52c4a74eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Volume 44d53d02-2a3a-4dd4-a976-63ff97ddf652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652', 'volume_size': 1} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:11 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 Sep 17 15:14:11 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:11 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270483701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff3b8f57-d2aa-4802-8aad-1c312351c427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:10Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Creating volume ff3b8f57-d2aa-4802-8aad-1c312351c427 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:11 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bfe51c1-354e-4611-a3b8-df19f5ed4e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e67ec703-324c-4474-856b-a8d0e3eaa641', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 1073741824 Sep 17 15:14:11 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa892ef1-34e0-404f-a156-e728cf0b7380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Volume volume-e67ec703-324c-4474-856b-a8d0e3eaa641 (e67ec703-324c-4474-856b-a8d0e3eaa641): created successfully Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa892ef1-34e0-404f-a156-e728cf0b7380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (7fbb2ad3-91c0-45d2-857f-03464f3ce8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-18c5b4bb-8fe0-4c8f-9541-5867fa4cbfa7 tempest-CreateVolumesFromImageTest-1246492414 None] Created volume successfully. Sep 17 15:14:12 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 1073741824" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:12 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 Sep 17 15:14:12 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:12 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.524s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1633463922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2ad665-b7c2-4c75-a0a2-8d82eec798d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:11Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Creating volume dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:12 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 1073741824 Sep 17 15:14:12 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eebccbbc-0ff7-49aa-8696-4ad84eef37b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff3b8f57-d2aa-4802-8aad-1c312351c427', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f85122c-c01b-4fba-a71f-ef39cb82b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Volume volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 (ff3b8f57-d2aa-4802-8aad-1c312351c427): created successfully Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f85122c-c01b-4fba-a71f-ef39cb82b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (5349efc0-b8b7-4dcb-92fa-3fae9d71d0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6cd284f3-5ab5-4a91-a12a-8daedc3fe707 tempest-CreateVolumesFromImageTest-1246492414 None] Created volume successfully. Sep 17 15:14:12 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 1073741824" returned: 0 in 0.430s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:12 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 Sep 17 15:14:12 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:13 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-749278544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44d53d02-2a3a-4dd4-a976-63ff97ddf652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d4bd1ff723f46838eae2fb91595ebdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:11Z,use_quota=True,user_id='242efac2a2cb4b6b90d5be090851ca0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Creating volume 44d53d02-2a3a-4dd4-a976-63ff97ddf652 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:13 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b82b5a81-6974-466e-98cc-14824a867ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580950d2-1eb8-4dd8-be7b-7963ae036322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:13 devstack sudo[102052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 1073741824 Sep 17 15:14:13 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Volume volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 (dc2ad665-b7c2-4c75-a0a2-8d82eec798d4): created successfully Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580950d2-1eb8-4dd8-be7b-7963ae036322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (340363a1-373b-4102-a0cc-2ebcb3497783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6f3667fb-14f8-4fa8-8a1d-1f9e07aa1562 tempest-CreateVolumesFromImageTest-1246492414 None] Created volume successfully. Sep 17 15:14:13 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 1073741824" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:13 devstack sudo[102057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 Sep 17 15:14:13 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:13 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a4cde-f5e1-413c-9edb-45b52c4a74eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d59d6f-57a7-4abb-85a6-a4fdc9f44e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:13 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Volume volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 (44d53d02-2a3a-4dd4-a976-63ff97ddf652): created successfully Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d59d6f-57a7-4abb-85a6-a4fdc9f44e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Flow 'volume_create_manager' (1af4fa8d-c97a-4a4b-a66c-52a7b57bfe01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-21781607-a7a8-4f7c-bed5-2f991573e4cf tempest-CreateVolumesFromImageTest-1246492414 None] Created volume successfully. Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-44d53d02-2a3a-4dd4-a976-63ff97ddf652-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-44d53d02-2a3a-4dd4-a976-63ff97ddf652-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-quobyte-44d53d02-2a3a-4dd4-a976-63ff97ddf652" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-44d53d02-2a3a-4dd4-a976-63ff97ddf652" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8294d-5467-438a-8827-c58591a44cec]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:14 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 Sep 17 15:14:14 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:15 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:15 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652 Sep 17 15:14:15 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:15 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-44d53d02-2a3a-4dd4-a976-63ff97ddf652" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-44d53d02-2a3a-4dd4-a976-63ff97ddf652" released by "delete_volume" :: held 0.668s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Created reservations ['67bdb1e0-a7f2-4762-907e-56dd5d1a5419', '6e0044cb-2a79-45fb-9297-63095879c449', '088a0bc3-c4c0-4d7e-84bd-efd979e466a3', 'ba0c6530-7fe7-48b9-84f5-b72abb050116'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:15 devstack sudo[102068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:15 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:15 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Deleted volume successfully. Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b944b30e-33ac-47e9-8329-36fa5ed50939 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-44d53d02-2a3a-4dd4-a976-63ff97ddf652-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-quobyte-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69d1dfe-ed62-4ec1-b5bf-96ccf52759e6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:16 devstack sudo[102071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 Sep 17 15:14:16 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:16 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:16 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4 Sep 17 15:14:16 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:16 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4" released by "delete_volume" :: held 0.651s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Created reservations ['f4411232-c730-48d1-b24a-db45e97836b1', 'c4343445-b91e-4e47-ba13-206032a2d825', '4c8ab8e0-72ef-4b9a-a214-3cc3a3d5b941', 'ee181802-a876-47be-8ab9-a8e677e388b5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:16 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:16 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:16 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:16 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Deleted volume successfully. Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f582ec0e-7ca7-43dd-87c2-7740e93aa827 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-dc2ad665-b7c2-4c75-a0a2-8d82eec798d4-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-ff3b8f57-d2aa-4802-8aad-1c312351c427-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-ff3b8f57-d2aa-4802-8aad-1c312351c427-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-quobyte-ff3b8f57-d2aa-4802-8aad-1c312351c427" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-ff3b8f57-d2aa-4802-8aad-1c312351c427" acquired by "delete_volume" :: waited 0.038s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd93aaae-65a3-4312-9fca-7702673dc82f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:17 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 Sep 17 15:14:17 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:17 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:17 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427 Sep 17 15:14:17 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:17 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ff3b8f57-d2aa-4802-8aad-1c312351c427" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-ff3b8f57-d2aa-4802-8aad-1c312351c427" released by "delete_volume" :: held 0.754s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:17 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Created reservations ['d7e37eeb-c71b-45dc-9985-146b216e0fcd', 'd1cf9ebe-66d5-4ea4-924e-040766999a1e', '8bd576a3-0590-406d-bf13-a3ead74d3716', '46916652-95d5-4935-b54e-a2b664c6347f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:18 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:18 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-e67ec703-324c-4474-856b-a8d0e3eaa641-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-e67ec703-324c-4474-856b-a8d0e3eaa641-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:18 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-quobyte-e67ec703-324c-4474-856b-a8d0e3eaa641" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:18 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Deleted volume successfully. Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-e67ec703-324c-4474-856b-a8d0e3eaa641" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0135065-a3e9-40cf-8626-9bec6a441cfe tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-ff3b8f57-d2aa-4802-8aad-1c312351c427-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[797ddaf3-b967-4677-aec6-81e7af1b0851]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:18 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 Sep 17 15:14:18 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:18 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:18 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641 Sep 17 15:14:18 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:19 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e67ec703-324c-4474-856b-a8d0e3eaa641" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-e67ec703-324c-4474-856b-a8d0e3eaa641" released by "delete_volume" :: held 0.689s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Created reservations ['b2f0dd90-c44c-4564-b35d-a3209d6ad270', 'd98746d0-c782-47ef-b09b-f02008fe62d9', 'd56fb32b-9a12-43ee-8501-e0fcd1e09c31', '129e0bcd-3230-48ff-b237-10c6f0f074a3'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:19 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:19 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:19 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Deleted volume successfully. Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-910c3a40-c73a-4d4e-8e0b-cc35a7ee3b1a tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-e67ec703-324c-4474-856b-a8d0e3eaa641-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "cinder-quobyte-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[00bedff3-cb09-45d5-a179-47964b2d65d5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:19 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 Sep 17 15:14:19 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:19 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:20 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696 Sep 17 15:14:20 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:20 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-quobyte-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696" released by "delete_volume" :: held 0.685s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Created reservations ['21f7755e-8025-40ba-95e4-53eaa362f687', '2bb83a26-ad9b-4fec-b783-65eaf3982a92', '3729bb6e-2ec3-438b-a243-3150e7bae055', '8aca0628-3854-411c-be65-d9a640f08d81'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:20 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:20 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:20 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:20 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Deleted volume successfully. Sep 17 15:14:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-341dff7e-b228-4ac8-8ad2-e24decb3c069 tempest-CreateVolumesFromImageTest-1246492414 None] Lock "cinder-0a6a5dbd-5601-4f1a-8108-31bdc9bb6696-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (71245629-a895-463a-8708-0536161d502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5186aac5-08b2-43d2-b826-80f39ddc450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5186aac5-08b2-43d2-b826-80f39ddc450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600367549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910001d4-8ec3-4c0b-83e1-3a1e052f0500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:28Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8a26bf-44de-474b-bd27-e9ff684a66d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e8a26bf-44de-474b-bd27-e9ff684a66d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38224e-aca7-4d7b-bf6a-7f57f1bf5d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc38224e-aca7-4d7b-bf6a-7f57f1bf5d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910001d4-8ec3-4c0b-83e1-3a1e052f0500', 'volume_name': 'volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d112af76-1fd1-48f6-b0c2-88bda4736bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d112af76-1fd1-48f6-b0c2-88bda4736bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e44da2-b3a6-494b-bd1e-76ae86ce1512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Volume 910001d4-8ec3-4c0b-83e1-3a1e052f0500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500', 'volume_size': 1} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1600367549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910001d4-8ec3-4c0b-83e1-3a1e052f0500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:28Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Creating volume 910001d4-8ec3-4c0b-83e1-3a1e052f0500 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:27 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 1073741824 Sep 17 15:14:27 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:28 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 1073741824" returned: 0 in 0.420s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:28 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 Sep 17 15:14:28 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:28 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e44da2-b3a6-494b-bd1e-76ae86ce1512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e3460b-1f30-4c0a-9f52-7164a261826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Volume volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 (910001d4-8ec3-4c0b-83e1-3a1e052f0500): created successfully Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e3460b-1f30-4c0a-9f52-7164a261826c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (71245629-a895-463a-8708-0536161d502d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-48961619-916f-42de-b00d-31d3e57359fa tempest-ProjectReaderTests-1948489846 None] Created volume successfully. Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-910001d4-8ec3-4c0b-83e1-3a1e052f0500-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-910001d4-8ec3-4c0b-83e1-3a1e052f0500-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-quobyte-910001d4-8ec3-4c0b-83e1-3a1e052f0500" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-910001d4-8ec3-4c0b-83e1-3a1e052f0500" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3108c98f-b83e-4080-8f40-f6aa5c9ec8bb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:29 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 Sep 17 15:14:29 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:29 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:29 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500 Sep 17 15:14:29 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:29 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-910001d4-8ec3-4c0b-83e1-3a1e052f0500" returned: 0 in 0.249s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-910001d4-8ec3-4c0b-83e1-3a1e052f0500" released by "delete_volume" :: held 0.639s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Created reservations ['87d3fca4-a523-4048-9ac2-0852e5d11d48', 'a2836ebc-bf8d-4eca-8330-fc0515f4966e', 'ba49e589-09b5-4c13-8e98-bb4ab87f50e4', '40e4c2be-afe0-497c-ab4e-0e078e1f171e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:29 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:29 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:30 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Deleted volume successfully. Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0604fecd-3287-41b6-b91d-5ba5bac6b506 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-910001d4-8ec3-4c0b-83e1-3a1e052f0500-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (1a8dd509-49d7-47a3-a9be-2e1f60311dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2716b85-ada2-4c34-ace3-9fea83cb1246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2716b85-ada2-4c34-ace3-9fea83cb1246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918276975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1651800b-392a-4718-bcbd-234828f52f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:31Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e20162c-c9c9-4c07-b995-9636e5893a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e20162c-c9c9-4c07-b995-9636e5893a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d888b384-9245-40dc-8e36-aece8e314e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d888b384-9245-40dc-8e36-aece8e314e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1651800b-392a-4718-bcbd-234828f52f3e', 'volume_name': 'volume-1651800b-392a-4718-bcbd-234828f52f3e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526d24e-ffc3-41f4-9161-eff0faaca842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526d24e-ffc3-41f4-9161-eff0faaca842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bd819a-4c28-4321-8c2d-9418c7ea99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:30 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Volume 1651800b-392a-4718-bcbd-234828f52f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1651800b-392a-4718-bcbd-234828f52f3e', 'volume_size': 1} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918276975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1651800b-392a-4718-bcbd-234828f52f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:31Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Creating volume 1651800b-392a-4718-bcbd-234828f52f3e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:30 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:30 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e 1073741824 Sep 17 15:14:30 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:31 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e 1073741824" returned: 0 in 0.409s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:31 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e Sep 17 15:14:31 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:31 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bd819a-4c28-4321-8c2d-9418c7ea99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1651800b-392a-4718-bcbd-234828f52f3e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed777f15-88ed-438d-afba-95c37df57600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:31 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Volume volume-1651800b-392a-4718-bcbd-234828f52f3e (1651800b-392a-4718-bcbd-234828f52f3e): created successfully Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed777f15-88ed-438d-afba-95c37df57600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (1a8dd509-49d7-47a3-a9be-2e1f60311dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb2cbfa8-0aa6-460c-a0c4-7db83c511e01 tempest-ProjectReaderTests-1948489846 None] Created volume successfully. Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-1651800b-392a-4718-bcbd-234828f52f3e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "cinder-1651800b-392a-4718-bcbd-234828f52f3e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-quobyte-1651800b-392a-4718-bcbd-234828f52f3e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-1651800b-392a-4718-bcbd-234828f52f3e" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[22995a06-944f-4445-b10f-6dabe67fda10]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e Sep 17 15:14:32 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e Sep 17 15:14:32 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1651800b-392a-4718-bcbd-234828f52f3e" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-1651800b-392a-4718-bcbd-234828f52f3e" released by "delete_volume" :: held 0.632s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Created reservations ['39889949-e554-4daa-b86e-4fd1f5af510a', '934275dd-6bf8-43a7-8f27-6fce85d730e5', '172227a6-6cb4-4464-b59f-365d6375bb00', 'bf8ab9e3-e046-4ed8-b417-e9707a42db24'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:32 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:32 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:32 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Deleted volume successfully. Sep 17 15:14:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d9ea160a-62ff-488b-9fef-0c226836772b tempest-ProjectReaderTests-1948489846 None] Lock "cinder-1651800b-392a-4718-bcbd-234828f52f3e-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (8f441d08-f946-446b-b7ec-486122f63cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513890d-84aa-4d13-879f-41cbaee4ae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f513890d-84aa-4d13-879f-41cbaee4ae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957105112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f8681-61fc-4df2-b07a-c54a207d8506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:33Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba2f1f8-ce00-4701-85af-102c03e82ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ba2f1f8-ce00-4701-85af-102c03e82ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee1b005-a357-432c-954d-9f9d21960597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee1b005-a357-432c-954d-9f9d21960597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62f8681-61fc-4df2-b07a-c54a207d8506', 'volume_name': 'volume-c62f8681-61fc-4df2-b07a-c54a207d8506', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36cc01-a170-4135-9a80-7714a6be1ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e36cc01-a170-4135-9a80-7714a6be1ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d387c-7187-46c0-acf6-bd3222ed3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Volume c62f8681-61fc-4df2-b07a-c54a207d8506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62f8681-61fc-4df2-b07a-c54a207d8506', 'volume_size': 1} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-957105112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62f8681-61fc-4df2-b07a-c54a207d8506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:33Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Creating volume c62f8681-61fc-4df2-b07a-c54a207d8506 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:33 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:33 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 1073741824 Sep 17 15:14:33 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:33 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 1073741824" returned: 0 in 0.424s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:33 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 Sep 17 15:14:33 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:34 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a2d387c-7187-46c0-acf6-bd3222ed3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62f8681-61fc-4df2-b07a-c54a207d8506', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bccdcf5-a2d5-4bb9-89ba-e3a0599db409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Volume volume-c62f8681-61fc-4df2-b07a-c54a207d8506 (c62f8681-61fc-4df2-b07a-c54a207d8506): created successfully Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bccdcf5-a2d5-4bb9-89ba-e3a0599db409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (8f441d08-f946-446b-b7ec-486122f63cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-84e07337-d123-4c32-b5fc-053a0061e995 tempest-ProjectReaderTests-1948489846 None] Created volume successfully. Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-c62f8681-61fc-4df2-b07a-c54a207d8506-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-c62f8681-61fc-4df2-b07a-c54a207d8506-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-quobyte-c62f8681-61fc-4df2-b07a-c54a207d8506" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-c62f8681-61fc-4df2-b07a-c54a207d8506" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7b02d9-538a-41b3-aca7-4080a2b53917]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:34 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 Sep 17 15:14:34 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:34 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:34 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506 Sep 17 15:14:34 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:35 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c62f8681-61fc-4df2-b07a-c54a207d8506" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-c62f8681-61fc-4df2-b07a-c54a207d8506" released by "delete_volume" :: held 0.634s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Created reservations ['802ade9f-0618-4f33-ad89-84c9b387d394', '52b77059-01ec-49b5-ae96-23539583e5dd', '28846bf4-0016-40b4-83f3-e04923c237ea', '078c4715-32bc-4c9d-b969-ebe5a4ce7553'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:35 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:35 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:35 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Deleted volume successfully. Sep 17 15:14:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b093b61d-a88a-4c59-8cf3-689eb1f7d044 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-c62f8681-61fc-4df2-b07a-c54a207d8506-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (47898fdf-e46a-4bc6-b27c-cb6347678988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71641e17-e661-4b3f-ac6d-68ee4dddeb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71641e17-e661-4b3f-ac6d-68ee4dddeb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763673000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de1bae4-4131-4ad6-8025-51efd2f70e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:36Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02933ad-b6fe-414c-b66c-9cacf2db9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02933ad-b6fe-414c-b66c-9cacf2db9a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33db0c10-00a4-4df0-8421-9c6c8fe0c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33db0c10-00a4-4df0-8421-9c6c8fe0c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de1bae4-4131-4ad6-8025-51efd2f70e6a', 'volume_name': 'volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9082344e-4e39-4d13-ae00-df76de924de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9082344e-4e39-4d13-ae00-df76de924de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5edc186-7109-428e-9e1e-0271ab700bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Volume 4de1bae4-4131-4ad6-8025-51efd2f70e6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a', 'volume_size': 1} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763673000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de1bae4-4131-4ad6-8025-51efd2f70e6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d4aca7bb3f439b92d290e7a7808720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:14:36Z,use_quota=True,user_id='feb6d07e3d2142298f10ebc56598cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Creating volume 4de1bae4-4131-4ad6-8025-51efd2f70e6a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:14:36 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:36 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a 1073741824 Sep 17 15:14:36 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:36 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a 1073741824" returned: 0 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:36 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a Sep 17 15:14:36 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:36 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5edc186-7109-428e-9e1e-0271ab700bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243a853-c498-448e-84a8-e885da21c43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:14:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Volume volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a (4de1bae4-4131-4ad6-8025-51efd2f70e6a): created successfully Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0243a853-c498-448e-84a8-e885da21c43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:14:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Flow 'volume_create_manager' (47898fdf-e46a-4bc6-b27c-cb6347678988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:14:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-55877ee2-0d6a-4ec3-bb08-7f6525f83484 tempest-ProjectReaderTests-1948489846 None] Created volume successfully. Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-4de1bae4-4131-4ad6-8025-51efd2f70e6a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-4de1bae4-4131-4ad6-8025-51efd2f70e6a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "cinder-quobyte-4de1bae4-4131-4ad6-8025-51efd2f70e6a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-4de1bae4-4131-4ad6-8025-51efd2f70e6a" acquired by "delete_volume" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca7f04d-11ea-4145-ab48-3867fc8ec555]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:37 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a Sep 17 15:14:37 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:37 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:37 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a Sep 17 15:14:37 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:37 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4de1bae4-4131-4ad6-8025-51efd2f70e6a" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-quobyte-4de1bae4-4131-4ad6-8025-51efd2f70e6a" released by "delete_volume" :: held 0.640s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Created reservations ['57ad37e0-1671-49f4-9d3e-b77f6a9f0870', '6ed64109-c77a-4d4b-96ec-f775139291d9', '55ef012a-f936-4dbf-9464-8dea20262d0e', 'cd31a8e6-0fb2-4957-b67f-17d88050294e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:37 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:37 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:38 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Deleted volume successfully. Sep 17 15:14:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-96fee72a-13a1-4fa9-b779-25789bd14e56 tempest-ProjectReaderTests-1948489846 None] Lock "cinder-4de1bae4-4131-4ad6-8025-51efd2f70e6a-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=80,cinder:UPDATE=107,cinder:INSERT=26,cinder:DELETE=10 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=93,cinder:UPDATE=120,cinder:DELETE=10,cinder:INSERT=24 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c89d154e-2505-457c-96af-c6ee65ae914d req-5e54bbca-2336-4dae-89fe-a9b280b6d665 tempest-TestShelveInstance-1534958268 None] Terminate volume connection completed successfully. Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [req-c89d154e-2505-457c-96af-c6ee65ae914d req-5e54bbca-2336-4dae-89fe-a9b280b6d665 tempest-TestShelveInstance-1534958268 None] Deleting attachment 4674ae44-debf-4a39-9d62-3e2b674f6237. {{(pid=85963) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Acquiring lock "cinder-6010613b-91ee-46c0-954c-ab7f5d4ec59d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "cinder-6010613b-91ee-46c0-954c-ab7f5d4ec59d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Acquiring lock "cinder-quobyte-6010613b-91ee-46c0-954c-ab7f5d4ec59d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "cinder-quobyte-6010613b-91ee-46c0-954c-ab7f5d4ec59d" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d5496f-2f02-4d53-83f3-a2800388563a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:44 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d Sep 17 15:14:44 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:44 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:44 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d Sep 17 15:14:44 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:45 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-6010613b-91ee-46c0-954c-ab7f5d4ec59d" returned: 0 in 0.263s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "cinder-quobyte-6010613b-91ee-46c0-954c-ab7f5d4ec59d" released by "delete_volume" :: held 0.683s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.quota [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Created reservations ['d3c13590-5c2c-4fba-9d80-23dc24d938c8', '3aaec7c2-f30d-4b4c-ab8c-7759aab4b5e9', '5dc0fb19-d3de-433b-bf8a-37daabbece9a', '2d972266-886f-4ab5-a397-6475b6df16b1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:45 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:45 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:45 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.manager [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Deleted volume successfully. Sep 17 15:14:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [req-c89d154e-2505-457c-96af-c6ee65ae914d req-6cadb657-ac5c-47b8-bdec-e8c89c9f2030 tempest-TestShelveInstance-1534958268 None] Lock "cinder-6010613b-91ee-46c0-954c-ab7f5d4ec59d-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:14:55 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:55 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:14:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:14:57 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:14:57 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:14:57 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 17 15:14:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:14:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:14:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:14:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:14:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Flow 'volume_create_manager' (9a24508e-2fcc-4607-bae5-ac2ecd9e4c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca679d0a-7b3b-40c1-b827-03df7462a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca679d0a-7b3b-40c1-b827-03df7462a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-543084335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdd67db-cb15-4eb0-8715-b67276dcd8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3048e19fa14f438796c2878fba119e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:16Z,use_quota=True,user_id='57db97287dee41a6a23ccb222373185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282179c-e6c0-4041-905d-12466af650d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6282179c-e6c0-4041-905d-12466af650d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf9b4e-340c-41c9-b016-e3e876646465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75cf9b4e-340c-41c9-b016-e3e876646465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdd67db-cb15-4eb0-8715-b67276dcd8dd', 'volume_name': 'volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a582f55-c0ac-44b5-b9ca-b5be95f355c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a582f55-c0ac-44b5-b9ca-b5be95f355c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a62f89-f4c0-4c0b-86ab-8826a413c568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:16 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Volume ecdd67db-cb15-4eb0-8715-b67276dcd8dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd', 'volume_size': 1} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-543084335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdd67db-cb15-4eb0-8715-b67276dcd8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3048e19fa14f438796c2878fba119e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:16Z,use_quota=True,user_id='57db97287dee41a6a23ccb222373185e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Creating volume ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:15:16 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:16 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd 1073741824 Sep 17 15:15:16 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:16 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd 1073741824" returned: 0 in 0.422s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:17 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:17 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:17 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a62f89-f4c0-4c0b-86ab-8826a413c568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db82dd9-7268-4e23-90a5-353e13cfaf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:17 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Volume volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd (ecdd67db-cb15-4eb0-8715-b67276dcd8dd): created successfully Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db82dd9-7268-4e23-90a5-353e13cfaf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:17 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Flow 'volume_create_manager' (9a24508e-2fcc-4607-bae5-ac2ecd9e4c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d35f651b-f79e-4c7b-891c-7f8ff3aa05e7 tempest-TestImageHashVerification-961219648 None] Created volume successfully. Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f778f-7a0d-425f-b020-df4ebaafca12]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:18 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:18 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:18 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.371s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5863b4e-2d53-40be-9606-7cce30b8742b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:18 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:18 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:18 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd /opt/stack/data/cinder/conversion/ecdd67db-cb15-4eb0-8715-b67276dcd8dd.temp_image.cdb80421-75c5-496d-958a-ca968e3c9e4bengc_xy4.img {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:18 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd /opt/stack/data/cinder/conversion/ecdd67db-cb15-4eb0-8715-b67276dcd8dd.temp_image.cdb80421-75c5-496d-958a-ca968e3c9e4bengc_xy4.img Sep 17 15:15:18 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:24 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd /opt/stack/data/cinder/conversion/ecdd67db-cb15-4eb0-8715-b67276dcd8dd.temp_image.cdb80421-75c5-496d-958a-ca968e3c9e4bengc_xy4.img" returned: 0 in 5.711s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd947f-1fae-42c8-b754-ffa90c1c31f6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:24 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:24 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:25 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.544s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd, size 1024.00 MB, duration 5.71 sec, destination /opt/stack/data/cinder/conversion/ecdd67db-cb15-4eb0-8715-b67276dcd8dd.temp_image.cdb80421-75c5-496d-958a-ca968e3c9e4bengc_xy4.img {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:15:25 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Converted 1024.00 MB image at 179.25 MB/s Sep 17 15:15:25 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] cdb80421-75c5-496d-958a-ca968e3c9e4b was raw, no need to convert to raw {{(pid=85963) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 17 15:15:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:35 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.826s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Uploaded volume to glance image-id: cdb80421-75c5-496d-958a-ca968e3c9e4b. {{(pid=85963) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 17 15:15:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-331de815-8eb7-4cad-ab3f-fe8dc03a973b tempest-TestImageHashVerification-961219648 None] Copy volume to image completed successfully. Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Acquiring lock "cinder-ecdd67db-cb15-4eb0-8715-b67276dcd8dd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "cinder-ecdd67db-cb15-4eb0-8715-b67276dcd8dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Acquiring lock "cinder-quobyte-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "cinder-quobyte-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d5b2fc-c512-4004-8df4-5153a39abf21]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:43 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:43 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd Sep 17 15:15:44 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "cinder-quobyte-ecdd67db-cb15-4eb0-8715-b67276dcd8dd" released by "delete_volume" :: held 0.654s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Created reservations ['b3f85a83-d927-4694-b1ac-909e5c2588a5', '999047da-27ed-4f37-873e-a08ad872ef4e', '7187d220-56fb-4dad-b6bb-b54c4ce91a40', '9b4d1b5d-625e-4b3c-8c62-7885569719e5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:44 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:15:44 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:44 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Deleted volume successfully. Sep 17 15:15:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-243a7531-9d29-4fd4-80db-1c8da0907e6b tempest-TestImageHashVerification-961219648 None] Lock "cinder-ecdd67db-cb15-4eb0-8715-b67276dcd8dd-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:15:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:54 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:15:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:57 devstack sudo[102436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:15:57 devstack sudo[102436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:57 devstack sudo[102436]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:15:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:15:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:15:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Flow 'volume_create_manager' (ec7c8719-8b97-4080-b2ca-fa30a77a1361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5075e0-ee8e-4d21-9124-4518bb6f0605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5075e0-ee8e-4d21-9124-4518bb6f0605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ae27f4-7f0d-4bba-b99e-9963efb8b426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1c354fafb04b7791c758a76166da64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:58Z,use_quota=True,user_id='34b21e620b434f71ab5f8ad47aa7ffbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(150a691a-7c10-457f-9f1d-adf5da45dcb7),volume_type_id=150a691a-7c10-457f-9f1d-adf5da45dcb7)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1e48cd-ee6c-4900-b05b-1216e8b02352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1e48cd-ee6c-4900-b05b-1216e8b02352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9941e367-a516-4935-b35e-165a8c5772bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9941e367-a516-4935-b35e-165a8c5772bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65ae27f4-7f0d-4bba-b99e-9963efb8b426', 'volume_name': 'volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426', 'volume_size': 1, 'image_id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc2061556356ffa6a6ef14ec15ee995f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db1c354fafb04b7791c758a76166da64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30cf83bcbd79e5734bc20057be676669f00c622789527ded0e9bbb00dcb82c4ea891a797c384f0ad165a173ba68f88d6da5ddaf066e97e76ef06c0a6dadfd569', 'id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5360f564-3af0-4b39-ad9e-a195e5cfbe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5360f564-3af0-4b39-ad9e-a195e5cfbe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d22c9e6-8461-4d40-b01c-227c8fb0763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:15:58 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426', 'volume_size': 1, 'image_id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc2061556356ffa6a6ef14ec15ee995f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db1c354fafb04b7791c758a76166da64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30cf83bcbd79e5734bc20057be676669f00c622789527ded0e9bbb00dcb82c4ea891a797c384f0ad165a173ba68f88d6da5ddaf066e97e76ef06c0a6dadfd569', 'id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Trying to clone 65ae27f4-7f0d-4bba-b99e-9963efb8b426 from image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d at location (None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:15:58 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4efa1bd-8a12-43d3-b90e-da21d99389af]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:15:59 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:15:59 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 1 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Temporary image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d is fetched for user 34b21e620b434f71ab5f8ad47aa7ffbe. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca93e81-61c2-4767-b5b1-f82407da7fe0]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:15:59 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:15:59 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:15:59 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:15:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:16:00 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 1 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ae27f4-7f0d-4bba-b99e-9963efb8b426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1c354fafb04b7791c758a76166da64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:15:58Z,use_quota=True,user_id='34b21e620b434f71ab5f8ad47aa7ffbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(150a691a-7c10-457f-9f1d-adf5da45dcb7),volume_type_id=150a691a-7c10-457f-9f1d-adf5da45dcb7)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Creating volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1073741824 Sep 17 15:16:00 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1073741824" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:00 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 Sep 17 15:16:00 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:00 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:00 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Attempting download of 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d ((None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}])) to volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29e2fb9-3c3f-40b1-8e11-3bf2af0a0a08]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5 Sep 17 15:16:01 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5 Sep 17 15:16:01 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5" returned: 1 in 0.311s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_8_ycegx5' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c4c2bc-58ef-4afd-94e8-5e0692b5df24]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:01 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:16:01 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:01 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 0 in 0.309s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[102479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD Sep 17 15:16:02 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD" returned: 1 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 Sep 17 15:16:02 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:02 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d_kil10pt0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:16:02 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:16:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:02 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1G Sep 17 15:16:02 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:03 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 1G" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Downloaded image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d ((None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}])) to volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Temporary image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d for user 34b21e620b434f71ab5f8ad47aa7ffbe is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Marking volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Copying metadata from image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d to 65ae27f4-7f0d-4bba-b99e-9963efb8b426. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Creating volume glance metadata for volume 65ae27f4-7f0d-4bba-b99e-9963efb8b426 backed by image 0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bc2061556356ffa6a6ef14ec15ee995f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d22c9e6-8461-4d40-b01c-227c8fb0763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426', 'volume_size': 1, 'image_id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bc2061556356ffa6a6ef14ec15ee995f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'db1c354fafb04b7791c758a76166da64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '30cf83bcbd79e5734bc20057be676669f00c622789527ded0e9bbb00dcb82c4ea891a797c384f0ad165a173ba68f88d6da5ddaf066e97e76ef06c0a6dadfd569', 'id': '0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d', 'created_at': datetime.datetime(2026, 9, 17, 13, 15, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 15, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0bb77a55-3cf0-4a40-bf54-b6ef86a0be6d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ec271a-d080-4e5d-bfdb-e1850e43db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Volume volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 (65ae27f4-7f0d-4bba-b99e-9963efb8b426): created successfully Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ec271a-d080-4e5d-bfdb-e1850e43db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Flow 'volume_create_manager' (ec7c8719-8b97-4080-b2ca-fa30a77a1361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b11dd014-d1d2-4da8-9f6a-93abdbad6f1d tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Created volume successfully. Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Acquiring lock "cinder-65ae27f4-7f0d-4bba-b99e-9963efb8b426-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "cinder-65ae27f4-7f0d-4bba-b99e-9963efb8b426-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Acquiring lock "cinder-quobyte-65ae27f4-7f0d-4bba-b99e-9963efb8b426" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "cinder-quobyte-65ae27f4-7f0d-4bba-b99e-9963efb8b426" acquired by "delete_volume" :: waited 0.012s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b921100-f1b9-4521-8ed0-01a08c797c9a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:03 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 Sep 17 15:16:03 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:04 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:04 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426 Sep 17 15:16:04 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:04 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-65ae27f4-7f0d-4bba-b99e-9963efb8b426" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "cinder-quobyte-65ae27f4-7f0d-4bba-b99e-9963efb8b426" released by "delete_volume" :: held 0.627s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:04 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:16:04 devstack cinder-volume[85963]: WARNING cinder.quota [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Created reservations ['f5ba5184-085d-4b4c-8ac6-65807284f9e9', 'b0b75089-4a0d-4b89-a7de-a7c4a52bab6b', '10bedd30-a01d-4069-8059-5ce42d017022', '9cc156ff-f791-477d-bc41-d717a0cce075'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:04 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:04 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:04 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Deleted volume successfully. Sep 17 15:16:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c187088a-e9f2-44cb-812e-919cac422aeb tempest-VolumeAndVolumeTypeFromImageTest-1832572424 None] Lock "cinder-65ae27f4-7f0d-4bba-b99e-9963efb8b426-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=12,cinder:DELETE=2 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:16:15 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:UPDATE=14,cinder:SELECT=8,cinder:INSERT=8 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (a14a7ce6-ac39-4f26-88e6-da2f620d5e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2c3c8a-3975-44e8-a989-4dca186c31bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2c3c8a-3975-44e8-a989-4dca186c31bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83591602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595b4a70-9fc7-47d5-9a59-946dd30c4a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:18Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f980e4f3-cb7a-41ce-81e8-259ed1d50682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f980e4f3-cb7a-41ce-81e8-259ed1d50682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365b028-7ce4-46b7-8e23-f517bbf8ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365b028-7ce4-46b7-8e23-f517bbf8ef39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595b4a70-9fc7-47d5-9a59-946dd30c4a7a', 'volume_name': 'volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb50409-ca73-4e40-ba45-f7e2e4958d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fb50409-ca73-4e40-ba45-f7e2e4958d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995b34b1-35c2-4d78-9349-35916a39f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume 595b4a70-9fc7-47d5-9a59-946dd30c4a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a', 'volume_size': 1} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-83591602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595b4a70-9fc7-47d5-9a59-946dd30c4a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:18Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume 595b4a70-9fc7-47d5-9a59-946dd30c4a7a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:18 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:18 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a 1073741824 Sep 17 15:16:18 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (65f44b9a-390c-477b-9eb6-26e3b5931300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a04e6ea-80a2-443f-9ce5-2adac764bb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a04e6ea-80a2-443f-9ce5-2adac764bb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433746302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa86acb-e88d-4c09-8274-d7ec844b1eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:18Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15057e0-f228-459e-a3e8-6781839abbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15057e0-f228-459e-a3e8-6781839abbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995025a3-22a1-4b9f-b8c0-09960fe6cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (995025a3-22a1-4b9f-b8c0-09960fe6cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa86acb-e88d-4c09-8274-d7ec844b1eab', 'volume_name': 'volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fd170-a167-4947-8759-f767473142ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f68fd170-a167-4947-8759-f767473142ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc4c2a-bae2-41ba-a4d6-d6dda70830fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:18 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Volume dfa86acb-e88d-4c09-8274-d7ec844b1eab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab', 'volume_size': 1} Sep 17 15:16:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (f0041355-3905-463d-b086-9728532f4d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b697b1ee-f9bc-4b02-8ff5-37b55a231be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b697b1ee-f9bc-4b02-8ff5-37b55a231be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-693499171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4128d6-8dd8-45d7-8299-911d02d5a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:19Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7ef93e-5797-4b80-b488-72f5a0601d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7ef93e-5797-4b80-b488-72f5a0601d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ea26f-ea2e-4b2d-9787-74dbd7f1cc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827ea26f-ea2e-4b2d-9787-74dbd7f1cc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4128d6-8dd8-45d7-8299-911d02d5a923', 'volume_name': 'volume-db4128d6-8dd8-45d7-8299-911d02d5a923', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca42f4e1-de54-4566-920c-0c3ebdfaeea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca42f4e1-de54-4566-920c-0c3ebdfaeea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acac19d-26b5-4039-b371-4e5b624ecc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Volume db4128d6-8dd8-45d7-8299-911d02d5a923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4128d6-8dd8-45d7-8299-911d02d5a923', 'volume_size': 1} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:19 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a 1073741824" returned: 0 in 0.688s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (4d53f579-2cfd-4b63-8d3a-0e664014886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9deab0-c393-4975-8cff-2028d760ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9deab0-c393-4975-8cff-2028d760ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523109187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:19Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe0570a-f8b9-4951-9290-d470f5f7b9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe0570a-f8b9-4951-9290-d470f5f7b9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf4dde8-51f5-4014-9760-e15ae394e9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf4dde8-51f5-4014-9760-e15ae394e9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f', 'volume_name': 'volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a986e25-eebd-4c72-9668-b05d22b3f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a986e25-eebd-4c72-9668-b05d22b3f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57917017-8d3a-4904-9f06-7d13b53ea16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume 9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f', 'volume_size': 1} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:19 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a Sep 17 15:16:19 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (2905183b-30c6-419a-bf9b-7e5e3f7266d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7a1c68-6b89-47e8-a441-2836607ac08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b7a1c68-6b89-47e8-a441-2836607ac08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554478021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1417443-04d1-468f-946f-0992c7bfd0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb653bbc-2d2e-42b4-bdea-b9970465eeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb653bbc-2d2e-42b4-bdea-b9970465eeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c47561c-dd37-462f-bec0-dfc76fd017c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c47561c-dd37-462f-bec0-dfc76fd017c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1417443-04d1-468f-946f-0992c7bfd0c7', 'volume_name': 'volume-b1417443-04d1-468f-946f-0992c7bfd0c7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcfb9ae-e694-40be-9a19-01ee736f19a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcfb9ae-e694-40be-9a19-01ee736f19a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697b0bcd-fcdf-4f93-a203-bb8a2aa5a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Volume b1417443-04d1-468f-946f-0992c7bfd0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1417443-04d1-468f-946f-0992c7bfd0c7', 'volume_size': 1} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:19 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433746302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa86acb-e88d-4c09-8274-d7ec844b1eab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:18Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Creating volume dfa86acb-e88d-4c09-8274-d7ec844b1eab {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:19 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab 1073741824 Sep 17 15:16:19 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995b34b1-35c2-4d78-9349-35916a39f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1f77d4-0382-4978-9dc0-1c4923726615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a (595b4a70-9fc7-47d5-9a59-946dd30c4a7a): created successfully Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f1f77d4-0382-4978-9dc0-1c4923726615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:19 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (a14a7ce6-ac39-4f26-88e6-da2f620d5e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2f45e146-6144-4541-9626-a47c05a5f4d7 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (576004f6-19f0-46b3-93fe-36f1c88fa437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba3e516-1116-4a56-8dd8-9350c75b5897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ba3e516-1116-4a56-8dd8-9350c75b5897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894574995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a2704f-22e6-4f83-bb9c-21ae3691d9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58119392-9e71-4eac-8358-31e981f9ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58119392-9e71-4eac-8358-31e981f9ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634da27-2417-416f-8c97-a9f00f6cff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634da27-2417-416f-8c97-a9f00f6cff43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12a2704f-22e6-4f83-bb9c-21ae3691d9a9', 'volume_name': 'volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158972de-5ec9-4690-815a-8c252bc88022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158972de-5ec9-4690-815a-8c252bc88022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e0fa69-d672-43c7-8c27-258150577895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Volume 12a2704f-22e6-4f83-bb9c-21ae3691d9a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9', 'volume_size': 1} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:20 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (95727e94-aba8-4ab2-a924-ee080eedb47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff281f5-3143-4937-89bc-2a1e3656d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab 1073741824" returned: 0 in 0.761s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ff281f5-3143-4937-89bc-2a1e3656d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727996177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d2b35b-f611-4cdb-b093-12bbe693eb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac14543-f2c5-4d33-a513-9c70608ee8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac14543-f2c5-4d33-a513-9c70608ee8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d3b294-51fc-4108-8fb6-5e7c187224f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d3b294-51fc-4108-8fb6-5e7c187224f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d2b35b-f611-4cdb-b093-12bbe693eb81', 'volume_name': 'volume-81d2b35b-f611-4cdb-b093-12bbe693eb81', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2975ab85-0083-4436-92cf-11b5684695ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2975ab85-0083-4436-92cf-11b5684695ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd89170-5b2d-4072-8b79-4ba57f878efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:20 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Volume 81d2b35b-f611-4cdb-b093-12bbe693eb81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d2b35b-f611-4cdb-b093-12bbe693eb81', 'volume_size': 1} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:20 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab Sep 17 15:16:20 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:20 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab" returned: 0 in 0.322s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-693499171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4128d6-8dd8-45d7-8299-911d02d5a923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:19Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Creating volume db4128d6-8dd8-45d7-8299-911d02d5a923 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:21 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 1073741824 Sep 17 15:16:21 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (5efd26e7-3d15-40ab-920d-fb9ca0d99faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38acb4-bcf6-454d-951e-2ddaf45580f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffcc4c2a-bae2-41ba-a4d6-d6dda70830fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29251f9e-508b-4009-94af-ea668d206cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d38acb4-bcf6-454d-951e-2ddaf45580f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783373963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84f0e8a-5e36-4917-9864-bd0c17810429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936b6807-3249-4a23-910a-7921f65a161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936b6807-3249-4a23-910a-7921f65a161b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a8f0df-af6e-48eb-a298-86ba6d1f007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a8f0df-af6e-48eb-a298-86ba6d1f007c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84f0e8a-5e36-4917-9864-bd0c17810429', 'volume_name': 'volume-e84f0e8a-5e36-4917-9864-bd0c17810429', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb7da71-ef1b-4d12-a16e-7dcf51f9e9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb7da71-ef1b-4d12-a16e-7dcf51f9e9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0d15f4-e8f3-494e-bd27-3e686f13e4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume e84f0e8a-5e36-4917-9864-bd0c17810429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84f0e8a-5e36-4917-9864-bd0c17810429', 'volume_size': 1} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Volume volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab (dfa86acb-e88d-4c09-8274-d7ec844b1eab): created successfully Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29251f9e-508b-4009-94af-ea668d206cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (65f44b9a-390c-477b-9eb6-26e3b5931300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1e97dc3e-c9be-45d6-ba33-196075c7134b tempest-CreateVolumesFromImageTest-1151316256 None] Created volume successfully. Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (5faa5fa6-0b33-4170-98c2-42cbf5801881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db782ce8-3022-4b69-826c-c71cd5763101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db782ce8-3022-4b69-826c-c71cd5763101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361047924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c7b95-d35f-4ea6-bfa9-50f56f51337e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b62e705-4193-484a-8037-9ca6bd848e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b62e705-4193-484a-8037-9ca6bd848e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c407a4-e700-4b77-99e3-de69754d008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c407a4-e700-4b77-99e3-de69754d008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e90c7b95-d35f-4ea6-bfa9-50f56f51337e', 'volume_name': 'volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eef850-93d7-41a8-b525-04d0bb7a3c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eef850-93d7-41a8-b525-04d0bb7a3c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b0af1-d0fe-4ef8-835d-c00767ee95d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume e90c7b95-d35f-4ea6-bfa9-50f56f51337e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e', 'volume_size': 1} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:21 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 1073741824" returned: 0 in 0.630s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:21 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 Sep 17 15:16:21 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (41073bab-b60e-4550-8b64-4673e0085f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff2b82f-0476-43b0-92f6-8d504966364f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923" returned: 0 in 0.376s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.556s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-523109187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:19Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume 9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:22 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff2b82f-0476-43b0-92f6-8d504966364f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859911293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:22Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f 1073741824 Sep 17 15:16:22 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c26d951-9277-4343-bc6f-2fe24065fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c26d951-9277-4343-bc6f-2fe24065fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1485a8-7754-40af-bc31-e7c95cd13a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1485a8-7754-40af-bc31-e7c95cd13a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3', 'volume_name': 'volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f20f344-a8c7-4843-8793-38be7400e9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f20f344-a8c7-4843-8793-38be7400e9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403c78ab-21c2-4d19-898f-ca4b9ad38ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume 556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3', 'volume_size': 1} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acac19d-26b5-4039-b371-4e5b624ecc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4128d6-8dd8-45d7-8299-911d02d5a923', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c168de-73b6-463d-90fa-0776ed72a71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Volume volume-db4128d6-8dd8-45d7-8299-911d02d5a923 (db4128d6-8dd8-45d7-8299-911d02d5a923): created successfully Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c168de-73b6-463d-90fa-0776ed72a71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (f0041355-3905-463d-b086-9728532f4d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bf5a2459-957c-4527-a26b-56de22cd51a6 tempest-CreateVolumesFromImageTest-1151316256 None] Created volume successfully. Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (9c94de1a-de90-4510-822b-1c639ac0a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1aad73-d784-47b7-85a9-6ba9b0e58611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be1aad73-d784-47b7-85a9-6ba9b0e58611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318466289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85027ba-382d-4cd5-9896-587bcfac3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:22Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99908466-1ef2-4620-b045-df1c57b6f186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99908466-1ef2-4620-b045-df1c57b6f186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c026f3dc-8c69-4820-bb53-3151cd4b7607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c026f3dc-8c69-4820-bb53-3151cd4b7607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd85027ba-382d-4cd5-9896-587bcfac3082', 'volume_name': 'volume-d85027ba-382d-4cd5-9896-587bcfac3082', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a2adad-098f-4ed5-be12-65f8451314ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a2adad-098f-4ed5-be12-65f8451314ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe6cb82-aecc-4cf6-a33a-077e7ea7bf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume d85027ba-382d-4cd5-9896-587bcfac3082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d85027ba-382d-4cd5-9896-587bcfac3082', 'volume_size': 1} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:22 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f 1073741824" returned: 0 in 0.629s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:22 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f Sep 17 15:16:22 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (77dce113-9ded-4f0e-925d-139ead9b94da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab335cd-8189-4717-b9b8-48632ab17d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab335cd-8189-4717-b9b8-48632ab17d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611208739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f7468-cb1e-45d5-b943-1e167cfda57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fa9a4a-47fc-4d51-8900-5fb6f7a6ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51fa9a4a-47fc-4d51-8900-5fb6f7a6ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4e836b-b945-4430-a2ca-c89a73d56763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4e836b-b945-4430-a2ca-c89a73d56763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef7f7468-cb1e-45d5-b943-1e167cfda57c', 'volume_name': 'volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebce2609-fc45-4ef4-a856-f87bd1f5a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebce2609-fc45-4ef4-a856-f87bd1f5a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd629b-3e54-44a2-ab9b-f6ff56821783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume ef7f7468-cb1e-45d5-b943-1e167cfda57c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c', 'volume_size': 1} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" returned: 0 in 0.332s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.355s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1554478021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1417443-04d1-468f-946f-0992c7bfd0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Creating volume b1417443-04d1-468f-946f-0992c7bfd0c7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57917017-8d3a-4904-9f06-7d13b53ea16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 1073741824 Sep 17 15:16:23 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d9686-0e63-4279-99e7-8ee89c32212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f (9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f): created successfully Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19d9686-0e63-4279-99e7-8ee89c32212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (4d53f579-2cfd-4b63-8d3a-0e664014886e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-00f5c6a9-d833-44e6-9503-6641b04b5e47 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Flow 'volume_create_manager' (e204ab26-cc41-4937-ba10-91da7078389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8856f9ab-cf81-4ad8-9c65-70d53223e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8856f9ab-cf81-4ad8-9c65-70d53223e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5dc92f-0c87-447b-9571-ee34d9c486a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06a443ab71d4d8285221d77620e26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='f54448c901584af79808123825417df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da4b219-a371-41b5-8cca-a939df52b45d),volume_type_id=1da4b219-a371-41b5-8cca-a939df52b45d)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce79db1a-f2c9-4cba-b58b-39e4cb99496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce79db1a-f2c9-4cba-b58b-39e4cb99496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f06318-da4f-49e6-9dff-1a971fceaee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19f06318-da4f-49e6-9dff-1a971fceaee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc5dc92f-0c87-447b-9571-ee34d9c486a2', 'volume_name': 'volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2', 'volume_size': 1, 'image_id': '0271412c-78b1-4586-b387-436db0cf9884', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b209a94309ecb3808bb745283d3467b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a443ab71d4d8285221d77620e26b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '405b84e758830a8e406e2ca04eeb31ac173ef9255cb9aa7d838a6080d42a4d24d9ff8b7d767c0ac38d89b5e73d57f2e8e6ff9fbd05171e2e1d57c50785f70a5c', 'id': '0271412c-78b1-4586-b387-436db0cf9884', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0271412c-78b1-4586-b387-436db0cf9884/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3454a2ad-ac66-4215-9662-6c3b80ef7223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3454a2ad-ac66-4215-9662-6c3b80ef7223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce5b18b-68d2-44d1-be15-ddcc458b2986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Volume bc5dc92f-0c87-447b-9571-ee34d9c486a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2', 'volume_size': 1, 'image_id': '0271412c-78b1-4586-b387-436db0cf9884', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b209a94309ecb3808bb745283d3467b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a443ab71d4d8285221d77620e26b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '405b84e758830a8e406e2ca04eeb31ac173ef9255cb9aa7d838a6080d42a4d24d9ff8b7d767c0ac38d89b5e73d57f2e8e6ff9fbd05171e2e1d57c50785f70a5c', 'id': '0271412c-78b1-4586-b387-436db0cf9884', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0271412c-78b1-4586-b387-436db0cf9884/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Trying to clone bc5dc92f-0c87-447b-9571-ee34d9c486a2 from image 0271412c-78b1-4586-b387-436db0cf9884 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:16:23 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 1073741824" returned: 0 in 0.486s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:16:23 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 Sep 17 15:16:23 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66a45ca-5ba5-4e5d-aff0-7877c1c3f969]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:23 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7" returned: 0 in 0.273s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.682s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894574995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12a2704f-22e6-4f83-bb9c-21ae3691d9a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Creating volume 12a2704f-22e6-4f83-bb9c-21ae3691d9a9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:23 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (697b0bcd-fcdf-4f93-a203-bb8a2aa5a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1417443-04d1-468f-946f-0992c7bfd0c7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:23 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 1073741824 Sep 17 15:16:23 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28845e8-a28f-4309-8c9c-ac1340614f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Volume volume-b1417443-04d1-468f-946f-0992c7bfd0c7 (b1417443-04d1-468f-946f-0992c7bfd0c7): created successfully Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28845e8-a28f-4309-8c9c-ac1340614f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (2905183b-30c6-419a-bf9b-7e5e3f7266d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a59503c3-1bbb-4a40-bc34-53024a4e6fc9 tempest-CreateVolumesFromImageTest-1151316256 None] Created volume successfully. Sep 17 15:16:24 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:24 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:24 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 1073741824" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Temporary image 0271412c-78b1-4586-b387-436db0cf9884 is fetched for user f54448c901584af79808123825417df6. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 Sep 17 15:16:24 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[09716bb3-5e3e-46e9-b82f-325470994e23]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack sudo[102607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:24 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" returned: 0 in 0.256s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1727996177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d2b35b-f611-4cdb-b093-12bbe693eb81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9af390303c4989ba14729f214b83f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:20Z,use_quota=True,user_id='95a46be164224b8b85987fae861cbf32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Creating volume 81d2b35b-f611-4cdb-b093-12bbe693eb81 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:24 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 1073741824 Sep 17 15:16:24 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e0fa69-d672-43c7-8c27-258150577895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5fc0b-77e3-4408-9e64-4919b50a0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:24 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Volume volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 (12a2704f-22e6-4f83-bb9c-21ae3691d9a9): created successfully Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5fc0b-77e3-4408-9e64-4919b50a0592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (576004f6-19f0-46b3-93fe-36f1c88fa437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3b65dd4e-6ca4-4cff-bb4f-c8ca273fec7f tempest-CreateVolumesFromImageTest-1151316256 None] Created volume successfully. Sep 17 15:16:24 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:24 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:24 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:25 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 1073741824" returned: 0 in 0.516s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:25 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 Sep 17 15:16:25 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.408s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1783373963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84f0e8a-5e36-4917-9864-bd0c17810429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume e84f0e8a-5e36-4917-9864-bd0c17810429 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:25 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:25 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 1073741824 Sep 17 15:16:25 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd89170-5b2d-4072-8b79-4ba57f878efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d2b35b-f611-4cdb-b093-12bbe693eb81', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5ccf74-ebb6-4ea1-bccf-04f4a9008344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:25 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Volume volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 (81d2b35b-f611-4cdb-b093-12bbe693eb81): created successfully Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5ccf74-ebb6-4ea1-bccf-04f4a9008344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Flow 'volume_create_manager' (95727e94-aba8-4ab2-a924-ee080eedb47c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:25 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-edfc1a32-f951-49a7-beac-461b0b26c6cc tempest-CreateVolumesFromImageTest-1151316256 None] Created volume successfully. Sep 17 15:16:25 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 1073741824" returned: 0 in 0.417s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 Sep 17 15:16:26 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.737s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1361047924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e90c7b95-d35f-4ea6-bfa9-50f56f51337e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:21Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume e90c7b95-d35f-4ea6-bfa9-50f56f51337e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:26 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0d15f4-e8f3-494e-bd27-3e686f13e4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84f0e8a-5e36-4917-9864-bd0c17810429', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:26 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e 1073741824 Sep 17 15:16:26 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d6f2d-93cb-49b2-b163-41ffc9ea8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-81d2b35b-f611-4cdb-b093-12bbe693eb81-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:26 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-e84f0e8a-5e36-4917-9864-bd0c17810429 (e84f0e8a-5e36-4917-9864-bd0c17810429): created successfully Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687d6f2d-93cb-49b2-b163-41ffc9ea8023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (5efd26e7-3d15-40ab-920d-fb9ca0d99faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cdbd881f-478d-42b5-b47f-e1b8f7c96a97 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-81d2b35b-f611-4cdb-b093-12bbe693eb81-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-quobyte-81d2b35b-f611-4cdb-b093-12bbe693eb81" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-81d2b35b-f611-4cdb-b093-12bbe693eb81" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d7ee86-fa58-4fa8-b55a-bc4d9efb16d3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 Sep 17 15:16:26 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e 1073741824" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e Sep 17 15:16:26 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:26 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81" returned: 0 in 0.421s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:26 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81 Sep 17 15:16:26 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.901s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859911293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:22Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume 556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae8b0af1-d0fe-4ef8-835d-c00767ee95d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:27 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 1073741824 Sep 17 15:16:27 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe34be-ac0d-41e0-a431-bba774500178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:27 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e (e90c7b95-d35f-4ea6-bfa9-50f56f51337e): created successfully Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe34be-ac0d-41e0-a431-bba774500178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (5faa5fa6-0b33-4170-98c2-42cbf5801881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8576528b-29a7-4394-a7a5-2e668daf258f tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:27 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-81d2b35b-f611-4cdb-b093-12bbe693eb81" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-81d2b35b-f611-4cdb-b093-12bbe693eb81" released by "delete_volume" :: held 0.749s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Created reservations ['47dc7275-a4b8-4a23-9a57-ae49d88ff045', '30c5ca70-ba42-41cd-aead-8e13415bd39f', 'cfa54325-f60a-49fd-986c-b024cd603b1d', '9a4c2d97-a5b9-41a1-b724-2fb9de28ce43'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:27 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-12a2704f-22e6-4f83-bb9c-21ae3691d9a9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-12a2704f-22e6-4f83-bb9c-21ae3691d9a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:27 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 1073741824" returned: 0 in 0.549s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-quobyte-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:27 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:27 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Deleted volume successfully. Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0abd4-4726-4ce3-a357-e86ab6354013]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9344b4cd-32f5-4e28-99c9-c5246c2018fc tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-81d2b35b-f611-4cdb-b093-12bbe693eb81-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:27 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 Sep 17 15:16:27 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 Sep 17 15:16:27 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.440s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318466289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d85027ba-382d-4cd5-9896-587bcfac3082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:22Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume d85027ba-382d-4cd5-9896-587bcfac3082 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:27 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403c78ab-21c2-4d19-898f-ca4b9ad38ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:27 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 1073741824 Sep 17 15:16:27 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:27 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858ce9c8-b87a-490c-b9f7-6e3894d78d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 (556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3): created successfully Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858ce9c8-b87a-490c-b9f7-6e3894d78d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (41073bab-b60e-4550-8b64-4673e0085f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3b9fecd5-c40b-494a-8222-74cb82342f34 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:28 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9 Sep 17 15:16:28 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-12a2704f-22e6-4f83-bb9c-21ae3691d9a9" released by "delete_volume" :: held 0.725s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Created reservations ['084ed4e0-c4bd-4fcd-832a-a1300c0369c6', 'ba7f9bb8-d447-457e-9c52-7b4ff2ba9634', '125e7c3c-833b-4e3c-9413-457bffce0b31', '3154ab21-4d2a-498d-a7af-b12feff234df'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:28 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 1073741824" returned: 0 in 0.512s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:28 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 Sep 17 15:16:28 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-b1417443-04d1-468f-946f-0992c7bfd0c7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-b1417443-04d1-468f-946f-0992c7bfd0c7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-quobyte-b1417443-04d1-468f-946f-0992c7bfd0c7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-b1417443-04d1-468f-946f-0992c7bfd0c7" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:28 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Deleted volume successfully. Sep 17 15:16:28 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082" returned: 0 in 0.302s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f839a3-a4dc-40db-8de4-749927bc5d2c]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.817s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-611208739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef7f7468-cb1e-45d5-b943-1e167cfda57c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e2b68b3004b4022bfc039b6c6402988',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='5c2be92400ca4fb08a8adbce6c2ee392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Creating volume ef7f7468-cb1e-45d5-b943-1e167cfda57c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:28 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c 1073741824 Sep 17 15:16:28 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe6cb82-aecc-4cf6-a33a-077e7ea7bf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d85027ba-382d-4cd5-9896-587bcfac3082', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dff042-bb63-45ed-95e6-a919c90df75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c6c19d68-076f-4217-be0a-abea1522670e tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-12a2704f-22e6-4f83-bb9c-21ae3691d9a9-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-d85027ba-382d-4cd5-9896-587bcfac3082 (d85027ba-382d-4cd5-9896-587bcfac3082): created successfully Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57dff042-bb63-45ed-95e6-a919c90df75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (9c94de1a-de90-4510-822b-1c639ac0a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8767ad5d-8869-4453-8955-b91f62972ca8 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:28 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 Sep 17 15:16:28 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7 Sep 17 15:16:29 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c 1073741824" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c Sep 17 15:16:29 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-b1417443-04d1-468f-946f-0992c7bfd0c7" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-b1417443-04d1-468f-946f-0992c7bfd0c7" released by "delete_volume" :: held 0.737s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Created reservations ['4a2dff0a-ee5f-489f-a930-305d9a7dffa9', 'b4cc1fa5-7c9e-439b-9765-2f8be547f4d8', '092e7db3-a830-4eb7-9122-f13d31fcb43b', '092505dd-9ed1-437d-b44b-363525190f12'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:29 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.502s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating offline snapshot 985da5cb-1220-461b-810d-f08ddb01c212 of volume 9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ccd629b-3e54-44a2-ab9b-f6ff56821783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5569f2c3-f326-4748-8869-01a943c8f42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9677045-d5cf-4897-9f1c-4703f26e09d5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Volume volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c (ef7f7468-cb1e-45d5-b943-1e167cfda57c): created successfully Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5569f2c3-f326-4748-8869-01a943c8f42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Flow 'volume_create_manager' (77dce113-9ded-4f0e-925d-139ead9b94da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4255cdf0-a4eb-4bd5-9c3d-666a7fe84092 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created volume successfully. Sep 17 15:16:29 devstack sudo[102703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:29 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f Sep 17 15:16:29 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-db4128d6-8dd8-45d7-8299-911d02d5a923-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-db4128d6-8dd8-45d7-8299-911d02d5a923-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-quobyte-db4128d6-8dd8-45d7-8299-911d02d5a923" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:29 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-db4128d6-8dd8-45d7-8299-911d02d5a923" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7421d2b-896b-4228-8a58-c8b415a96dc3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Deleted volume successfully. Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ce69d61-41a1-4457-969f-1bf2efe39075 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-b1417443-04d1-468f-946f-0992c7bfd0c7-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:30 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" returned: 0 in 0.434s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 Sep 17 15:16:30 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 1G Sep 17 15:16:30 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923 Sep 17 15:16:30 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 1G" returned: 0 in 0.454s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 Sep 17 15:16:30 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-ef7f7468-cb1e-45d5-b943-1e167cfda57c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:30 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-db4128d6-8dd8-45d7-8299-911d02d5a923" returned: 0 in 0.281s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-ef7f7468-cb1e-45d5-b943-1e167cfda57c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-db4128d6-8dd8-45d7-8299-911d02d5a923" released by "delete_volume" :: held 0.780s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-ef7f7468-cb1e-45d5-b943-1e167cfda57c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-ef7f7468-cb1e-45d5-b943-1e167cfda57c" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Created reservations ['c74fbcc8-0cbf-4fd4-bac4-1e589a56d485', '5e7dc9d6-650b-4584-9044-fd43f890e2dc', '619cff92-637d-47a9-b130-44c3e2e88016', 'e0039b77-d792-49ab-b6c0-00959d020d90'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0837fe4-e049-410b-a145-98e15fb5d25d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212" returned: 0 in 0.349s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:30 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 is being set with open permissions: ugo+rw Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 Sep 17 15:16:30 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:30 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c Sep 17 15:16:30 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:30 devstack sudo[102732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:31 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-dfa86acb-e88d-4c09-8274-d7ec844b1eab-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-dfa86acb-e88d-4c09-8274-d7ec844b1eab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "cinder-quobyte-dfa86acb-e88d-4c09-8274-d7ec844b1eab" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-dfa86acb-e88d-4c09-8274-d7ec844b1eab" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d626b-c5d4-4906-98d1-2ef207c0949a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212" returned: 0 in 0.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab Sep 17 15:16:31 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info Sep 17 15:16:31 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c Sep 17 15:16:31 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Deleted volume successfully. Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8ba9873c-0542-4405-a014-b39690ccff58 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-db4128d6-8dd8-45d7-8299-911d02d5a923-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info is being set with open permissions: ugo+rw Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab Sep 17 15:16:31 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-ef7f7468-cb1e-45d5-b943-1e167cfda57c" returned: 0 in 0.301s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info Sep 17 15:16:31 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-ef7f7468-cb1e-45d5-b943-1e167cfda57c" released by "delete_volume" :: held 0.798s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['b2fff614-66c9-4530-a70a-45d988afecda', 'c54b2125-6dc5-4e41-9e97-f98ab6b008c6', '7d425cbf-8b2a-4ec6-a395-c6843b05e9d9', '3b252bd6-e363-40be-9da1-896090828928'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:31 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dfa86acb-e88d-4c09-8274-d7ec844b1eab" returned: 0 in 0.279s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.info" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.258s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-quobyte-dfa86acb-e88d-4c09-8274-d7ec844b1eab" released by "delete_volume" :: held 0.741s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.672s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5dc92f-0c87-447b-9571-ee34d9c486a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06a443ab71d4d8285221d77620e26b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:23Z,use_quota=True,user_id='f54448c901584af79808123825417df6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1da4b219-a371-41b5-8cca-a939df52b45d),volume_type_id=1da4b219-a371-41b5-8cca-a939df52b45d)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Creating volume bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:31 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-d85027ba-382d-4cd5-9896-587bcfac3082-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:31 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1073741824 Sep 17 15:16:31 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-d85027ba-382d-4cd5-9896-587bcfac3082-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ee494604-b84a-4753-ab86-3d599da53189 tempest-CreateVolumesFromSnapshotTest-651177151 None] Create snapshot completed successfully Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-d85027ba-382d-4cd5-9896-587bcfac3082" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:32 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-d85027ba-382d-4cd5-9896-587bcfac3082" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.316s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Created reservations ['bd61107e-2d60-4dd7-8bcd-02d142c72dc6', '27f51d10-d247-4509-8c44-6e7ec692dff8', '278e4411-222d-43fc-a94e-972d8655d3cb', 'c0530998-a007-4e22-9313-15e6f24e3e03'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[611f4cf8-f37f-47ed-81e0-25b4fa502364]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8c2028e4-8a17-43d8-8800-18cdd31eb762 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-ef7f7468-cb1e-45d5-b943-1e167cfda57c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:32 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 Sep 17 15:16:32 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1073741824" returned: 0 in 0.540s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:32 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 Sep 17 15:16:32 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Deleted volume successfully. Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d55653fc-9b53-4236-b105-6d609d0ef426 tempest-CreateVolumesFromImageTest-1151316256 None] Lock "cinder-dfa86acb-e88d-4c09-8274-d7ec844b1eab-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:32 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:32 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082 Sep 17 15:16:32 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:32 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Attempting download of 0271412c-78b1-4586-b387-436db0cf9884 ((None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}])) to volume bc5dc92f-0c87-447b-9571-ee34d9c486a2. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc8986c-67e2-4b13-aa7a-a42fefb66e02]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d85027ba-382d-4cd5-9896-587bcfac3082" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-d85027ba-382d-4cd5-9896-587bcfac3082" released by "delete_volume" :: held 1.054s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:33 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce Sep 17 15:16:33 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (15509a35-5963-4f77-9023-c936e136a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b821bba8-57ce-4c48-81df-077b10d88291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b821bba8-57ce-4c48-81df-077b10d88291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227859584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ee16d1-37fc-43f6-810d-a492797d78f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:33Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ad0193-0a3b-47e5-8a4a-608cdb8a4c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ad0193-0a3b-47e5-8a4a-608cdb8a4c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4670a0d7-cd6e-47e3-aaea-bfee9dab1bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4670a0d7-cd6e-47e3-aaea-bfee9dab1bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ee16d1-37fc-43f6-810d-a492797d78f0', 'volume_name': 'volume-71ee16d1-37fc-43f6-810d-a492797d78f0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65431a30-c0e5-4ba5-ba34-e9201096f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65431a30-c0e5-4ba5-ba34-e9201096f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0106e8ca-a505-4cb3-bf65-1b53f5950096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume 71ee16d1-37fc-43f6-810d-a492797d78f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ee16d1-37fc-43f6-810d-a492797d78f0', 'volume_size': 1} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1227859584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ee16d1-37fc-43f6-810d-a492797d78f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:33Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume 71ee16d1-37fc-43f6-810d-a492797d78f0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:33 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['f8c7d7b6-98d4-4b1b-ab8e-72097bcf2a1c', 'a7f5f445-bd97-4ba0-af0c-f31ce33f0b6a', '7c9dfd1e-5a98-47cc-9e43-d55b282c9f0d', '47319431-c776-46c9-b72b-97b11815b8dd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:33 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 1073741824 Sep 17 15:16:33 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:33 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:33 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:33 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:33 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce Sep 17 15:16:33 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (f4eccae2-7b7a-49c9-8f59-c2855c41f560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4006c55-16f5-4802-b0fa-65fcff333f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4006c55-16f5-4802-b0fa-65fcff333f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420948066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40086f45-36ba-4810-93b9-6fcdbeac693a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:34Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c2cb11-f978-4b5a-90c8-4b610f94a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:33 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c2cb11-f978-4b5a-90c8-4b610f94a2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8a577b-c6ca-477b-8672-a8a1fb73ca09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d8a577b-c6ca-477b-8672-a8a1fb73ca09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40086f45-36ba-4810-93b9-6fcdbeac693a', 'volume_name': 'volume-40086f45-36ba-4810-93b9-6fcdbeac693a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b38b640-5c05-44cf-b937-83e7e6886f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b38b640-5c05-44cf-b937-83e7e6886f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eb5a1f-686d-4fcd-88b5-dbdeba0c3402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume 40086f45-36ba-4810-93b9-6fcdbeac693a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40086f45-36ba-4810-93b9-6fcdbeac693a', 'volume_size': 1} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.553s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 1073741824" returned: 0 in 0.790s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce" returned: 1 in 0.628s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0271412c-78b1-4586-b387-436db0cf9884_6np_q3ce' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddd94e2-16c7-4550-a1b8-2e3f89a76e2e]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ab8e83dc-2109-4cfd-97c9-4b99b3abc801 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-d85027ba-382d-4cd5-9896-587bcfac3082-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 Sep 17 15:16:34 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack sudo[102799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:34 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" acquired by "delete_volume" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:34 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0b8e17-93fb-47e7-a926-cab5ab9ca00a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.477s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-420948066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40086f45-36ba-4810-93b9-6fcdbeac693a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:34Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume 40086f45-36ba-4810-93b9-6fcdbeac693a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:34 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a 1073741824 Sep 17 15:16:34 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0106e8ca-a505-4cb3-bf65-1b53f5950096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ee16d1-37fc-43f6-810d-a492797d78f0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fccb34-2b02-434b-87f0-0938db0aa69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 0 in 0.559s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-71ee16d1-37fc-43f6-810d-a492797d78f0 (71ee16d1-37fc-43f6-810d-a492797d78f0): created successfully Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fccb34-2b02-434b-87f0-0938db0aa69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (15509a35-5963-4f77-9023-c936e136a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:34 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-11eb1a12-39fd-433a-88fd-1c2270ff6f45 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (39ca2aa4-e174-4939-96b2-68ee74f4f6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf198f06-751d-43cb-a608-44e9b4df2732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf198f06-751d-43cb-a608-44e9b4df2732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944875118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd76e8a-20d1-4874-a3fa-24d56174958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:35Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD Sep 17 15:16:34 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabec2fb-a2d4-48d4-b9ca-a60d46cd9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dabec2fb-a2d4-48d4-b9ca-a60d46cd9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8684c1-d53c-4d70-b886-e52f08df95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8684c1-d53c-4d70-b886-e52f08df95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd76e8a-20d1-4874-a3fa-24d56174958f', 'volume_name': 'volume-0bd76e8a-20d1-4874-a3fa-24d56174958f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee270322-33ee-4ed6-b6d1-256bf659827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee270322-33ee-4ed6-b6d1-256bf659827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356bc60c-ed0a-4cf0-8d77-864e03b0d903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume 0bd76e8a-20d1-4874-a3fa-24d56174958f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd76e8a-20d1-4874-a3fa-24d56174958f', 'volume_size': 1} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (8ea987f6-abad-4f30-b7c6-95db155c4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400559b6-364a-4e8a-af75-e0cf9fb32613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (400559b6-364a-4e8a-af75-e0cf9fb32613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666750738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54185b1-e4fe-49d4-9206-ab626f68aa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:35Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e7dd17-c353-4b11-a0e5-ed7e8b91edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e7dd17-c353-4b11-a0e5-ed7e8b91edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4e855a-967b-4670-b185-a40cec402b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4e855a-967b-4670-b185-a40cec402b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54185b1-e4fe-49d4-9206-ab626f68aa4a', 'volume_name': 'volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a33d8-2a85-4d27-936c-5a29180e8cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255a33d8-2a85-4d27-936c-5a29180e8cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba3acd4-c0b4-4f36-9dd5-ccfad964fbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume e54185b1-e4fe-49d4-9206-ab626f68aa4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a', 'volume_size': 1} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD" returned: 1 in 0.622s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" returned: 0 in 0.685s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] 0271412c-78b1-4586-b387-436db0cf9884 was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 Sep 17 15:16:35 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3 Sep 17 15:16:35 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a 1073741824" returned: 0 in 0.869s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack sudo[102826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a Sep 17 15:16:35 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3" released by "delete_volume" :: held 1.235s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (c836f4c0-986e-48ed-9033-dc31881d35f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b384d19e-c7ac-4b17-b405-fae83fd4265a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b384d19e-c7ac-4b17-b405-fae83fd4265a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745078899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c87be9a-180d-4f1b-8f75-12695eee9313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:36Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ec8f89-427d-48b9-83f7-28c4ec63c955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ec8f89-427d-48b9-83f7-28c4ec63c955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c88c02-3a5c-40a2-90e2-a7f10de46ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74c88c02-3a5c-40a2-90e2-a7f10de46ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c87be9a-180d-4f1b-8f75-12695eee9313', 'volume_name': 'volume-1c87be9a-180d-4f1b-8f75-12695eee9313', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d519777b-e8ea-4d3f-81aa-45634b279cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d519777b-e8ea-4d3f-81aa-45634b279cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ec68ca-327c-44c3-9651-dad69fd84484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume 1c87be9a-180d-4f1b-8f75-12695eee9313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c87be9a-180d-4f1b-8f75-12695eee9313', 'volume_size': 1} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a" returned: 0 in 0.343s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1944875118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd76e8a-20d1-4874-a3fa-24d56174958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:35Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume 0bd76e8a-20d1-4874-a3fa-24d56174958f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eb5a1f-686d-4fcd-88b5-dbdeba0c3402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40086f45-36ba-4810-93b9-6fcdbeac693a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f 1073741824 Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507688e3-6956-4899-9e85-e6f05997b0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:35 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-40086f45-36ba-4810-93b9-6fcdbeac693a (40086f45-36ba-4810-93b9-6fcdbeac693a): created successfully Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507688e3-6956-4899-9e85-e6f05997b0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (f4eccae2-7b7a-49c9-8f59-c2855c41f560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['c74ffbe0-0df1-4df0-9c57-7ff2bdfc37e5', 'd3eb7d4f-76f2-4193-b94b-aca6bcf53c16', 'b5d655e9-d6d0-47a3-9352-f683428a59f4', 'eb855cad-f642-46ba-b6ae-067c5c89bc23'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-86c9dacf-4193-4f0b-a514-e7b5999537c7 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:36 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2" returned: 0 in 0.757s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0271412c-78b1-4586-b387-436db0cf9884_yloswgnudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:36 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1G Sep 17 15:16:36 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.355s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-da9bb24f-2844-441d-9f89-3d627434b4db tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-556ee8cd-b14a-42eb-b0cd-bf3d7a7abfe3-delete_volume" released by "delete_volume" :: held 2.101s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:36 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 1G" returned: 0 in 0.402s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Downloaded image 0271412c-78b1-4586-b387-436db0cf9884 ((None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}])) to volume bc5dc92f-0c87-447b-9571-ee34d9c486a2 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Temporary image 0271412c-78b1-4586-b387-436db0cf9884 for user f54448c901584af79808123825417df6 is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Marking volume bc5dc92f-0c87-447b-9571-ee34d9c486a2 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:16:36 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f 1073741824" returned: 0 in 0.594s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Copying metadata from image 0271412c-78b1-4586-b387-436db0cf9884 to bc5dc92f-0c87-447b-9571-ee34d9c486a2. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Creating volume glance metadata for volume bc5dc92f-0c87-447b-9571-ee34d9c486a2 backed by image 0271412c-78b1-4586-b387-436db0cf9884 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0271412c-78b1-4586-b387-436db0cf9884', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b209a94309ecb3808bb745283d3467b0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f Sep 17 15:16:36 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce5b18b-68d2-44d1-be15-ddcc458b2986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2', 'volume_size': 1, 'image_id': '0271412c-78b1-4586-b387-436db0cf9884', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0271412c-78b1-4586-b387-436db0cf9884', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b209a94309ecb3808bb745283d3467b0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f06a443ab71d4d8285221d77620e26b9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '405b84e758830a8e406e2ca04eeb31ac173ef9255cb9aa7d838a6080d42a4d24d9ff8b7d767c0ac38d89b5e73d57f2e8e6ff9fbd05171e2e1d57c50785f70a5c', 'id': '0271412c-78b1-4586-b387-436db0cf9884', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0271412c-78b1-4586-b387-436db0cf9884/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410529f-42dc-4c3a-a3ad-74fb88c91413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Volume volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 (bc5dc92f-0c87-447b-9571-ee34d9c486a2): created successfully Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1410529f-42dc-4c3a-a3ad-74fb88c91413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Flow 'volume_create_manager' (e204ab26-cc41-4937-ba10-91da7078389c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6ecfd8a7-015c-4f55-b299-658dcad78480 tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Created volume successfully. Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-e90c7b95-d35f-4ea6-bfa9-50f56f51337e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-e90c7b95-d35f-4ea6-bfa9-50f56f51337e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[812dddf9-1f6e-4378-885a-75ad6ca0145b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1666750738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54185b1-e4fe-49d4-9206-ab626f68aa4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:35Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume e54185b1-e4fe-49d4-9206-ab626f68aa4a {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:36 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a 1073741824 Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (356bc60c-ed0a-4cf0-8d77-864e03b0d903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd76e8a-20d1-4874-a3fa-24d56174958f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:36 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93baf3cb-505c-49f0-905b-646832b21195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-0bd76e8a-20d1-4874-a3fa-24d56174958f (0bd76e8a-20d1-4874-a3fa-24d56174958f): created successfully Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93baf3cb-505c-49f0-905b-646832b21195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (39ca2aa4-e174-4939-96b2-68ee74f4f6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:36 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e Sep 17 15:16:36 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c97b69be-9a26-4822-bd5a-61bb47d0fc27 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:37 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e Sep 17 15:16:37 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Acquiring lock "cinder-bc5dc92f-0c87-447b-9571-ee34d9c486a2-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "cinder-bc5dc92f-0c87-447b-9571-ee34d9c486a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-c2c12978-e808-41d9-a3f3-96823fce2828 tempest-ProjectAdminTests-1305025937 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.8068466186523, 'free_capacity_gb': 1775.8068466186523, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85963) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Acquiring lock "cinder-quobyte-bc5dc92f-0c87-447b-9571-ee34d9c486a2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "cinder-quobyte-bc5dc92f-0c87-447b-9571-ee34d9c486a2" acquired by "delete_volume" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:37 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a 1073741824" returned: 0 in 0.586s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[039c5384-cedc-444f-9729-78f0962ba8e9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a Sep 17 15:16:37 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" returned: 0 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 Sep 17 15:16:37 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-e90c7b95-d35f-4ea6-bfa9-50f56f51337e" released by "delete_volume" :: held 0.855s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['9ac0756f-86e7-40d3-a520-413cfb612cb0', 'ed26f783-ee42-44ee-9fdf-580a21c6e992', 'e085b942-516a-4264-b855-ad78176a3b10', '469747a2-50f5-423f-9572-748e6ea0a3e6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:37 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-745078899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c87be9a-180d-4f1b-8f75-12695eee9313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a8173c2dd854ba393846b2486ace2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:36Z,use_quota=True,user_id='ae4bb61c460d4dbf8cb66735f42cfd0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Creating volume 1c87be9a-180d-4f1b-8f75-12695eee9313 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:37 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:37 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 1073741824 Sep 17 15:16:37 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-e84f0e8a-5e36-4917-9864-bd0c17810429-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba3acd4-c0b4-4f36-9dd5-ccfad964fbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7438b0-2eb7-4afe-b36b-e1b55132bd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a (e54185b1-e4fe-49d4-9206-ab626f68aa4a): created successfully Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7438b0-2eb7-4afe-b36b-e1b55132bd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (8ea987f6-abad-4f30-b7c6-95db155c4c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-e84f0e8a-5e36-4917-9864-bd0c17810429-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:38 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2" returned: 0 in 0.676s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7cfd75c2-bfb5-41a6-b08b-b8ae28aea272 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:38 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2 Sep 17 15:16:38 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-e84f0e8a-5e36-4917-9864-bd0c17810429" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:38 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-e84f0e8a-5e36-4917-9864-bd0c17810429" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.451s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b6aacf-6a42-4c25-93f3-14a4a0f9d28a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b6292316-38dc-4141-a7e6-71f37d99b131 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-e90c7b95-d35f-4ea6-bfa9-50f56f51337e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:38 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 Sep 17 15:16:38 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5dc92f-0c87-447b-9571-ee34d9c486a2" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "cinder-quobyte-bc5dc92f-0c87-447b-9571-ee34d9c486a2" released by "delete_volume" :: held 1.061s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Created reservations ['b3c0e54a-d824-4f04-907f-23465251264f', '1650293c-378f-4989-bb13-b0011f315d7e', 'b3230e04-5574-4e83-aaee-fa55afffb313', '5c847c54-7654-42e2-b597-fe426935e20a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:38 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 1073741824" returned: 0 in 0.637s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 Sep 17 15:16:38 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:38 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429" returned: 0 in 0.479s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:38 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429 Sep 17 15:16:38 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:38 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313" returned: 0 in 0.379s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ec68ca-327c-44c3-9651-dad69fd84484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c87be9a-180d-4f1b-8f75-12695eee9313', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b82a9b-f272-4ce5-a2eb-05bc8177176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Volume volume-1c87be9a-180d-4f1b-8f75-12695eee9313 (1c87be9a-180d-4f1b-8f75-12695eee9313): created successfully Sep 17 15:16:39 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b82a9b-f272-4ce5-a2eb-05bc8177176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Flow 'volume_create_manager' (c836f4c0-986e-48ed-9033-dc31881d35f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Deleted volume successfully. Sep 17 15:16:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-405aba7a-fc8b-4196-8ce8-f0e42d249c2e tempest-CreateVolumesFromSnapshotTest-651177151 None] Created volume successfully. Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1b027f40-3540-4eaf-a61d-8cb8e86416dc tempest-VolumeAndVolumeTypeFromImageTest-1178384644 None] Lock "cinder-bc5dc92f-0c87-447b-9571-ee34d9c486a2-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:39 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e84f0e8a-5e36-4917-9864-bd0c17810429" returned: 0 in 0.395s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-e84f0e8a-5e36-4917-9864-bd0c17810429" released by "delete_volume" :: held 0.930s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['335723d1-8eb0-4636-8047-25a845352645', '7d2cbbaa-3862-4abc-8785-361a2975320e', '2f51eb42-767a-4dc5-add3-409cf32796a1', '130d14dc-25a8-4312-8f18-184f23035d95'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:39 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:39 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:39 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.278s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7c8dbd06-ee32-449e-9463-9933c954d5d5 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-e84f0e8a-5e36-4917-9864-bd0c17810429-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-1c87be9a-180d-4f1b-8f75-12695eee9313-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-1c87be9a-180d-4f1b-8f75-12695eee9313-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-595b4a70-9fc7-47d5-9a59-946dd30c4a7a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-595b4a70-9fc7-47d5-9a59-946dd30c4a7a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-1c87be9a-180d-4f1b-8f75-12695eee9313" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-1c87be9a-180d-4f1b-8f75-12695eee9313" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "cinder-quobyte-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[15db64c7-20db-4aeb-b217-1911b11b6135]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9040e68-7717-4986-9350-ccff08a753ed]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 Sep 17 15:16:40 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a Sep 17 15:16:40 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313" returned: 0 in 0.465s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313 Sep 17 15:16:40 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:40 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" returned: 0 in 0.441s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:40 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a Sep 17 15:16:40 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1c87be9a-180d-4f1b-8f75-12695eee9313" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-1c87be9a-180d-4f1b-8f75-12695eee9313" released by "delete_volume" :: held 0.864s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" returned: 0 in 0.372s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-quobyte-595b4a70-9fc7-47d5-9a59-946dd30c4a7a" released by "delete_volume" :: held 0.881s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['73ff5c3b-92a0-4495-855a-ec304b3c29e8', '8fe45762-2713-4207-a6cf-7e5288fed4b0', '386db1d2-4990-4707-ab67-51caee6d557d', '24c20173-7c4c-4ba6-8bc3-2cbf151cdb4f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Created reservations ['b5463175-804d-4213-bcd3-08395535daf9', 'f50bad31-8265-466f-bf8c-e7be20e6a309', '796308e7-fc93-4480-bb97-fe77883c1fbe', 'dce4d00f-1c02-4ba6-a6df-a9bf760f67e5'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:41 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-e54185b1-e4fe-49d4-9206-ab626f68aa4a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-e54185b1-e4fe-49d4-9206-ab626f68aa4a-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:41 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:41 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-e54185b1-e4fe-49d4-9206-ab626f68aa4a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-e54185b1-e4fe-49d4-9206-ab626f68aa4a" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[35276a14-ac4e-4c77-888c-928a9b8a20e3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:41 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fbebb216-28b2-47a3-aa1b-bf6112af7f9c tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-1c87be9a-180d-4f1b-8f75-12695eee9313-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.344s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Deleted volume successfully. Sep 17 15:16:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-99daaa79-a076-49a8-b15b-39c475e55ee1 tempest-CreateVolumesFromSourceVolumeTest-1904771489 None] Lock "cinder-595b4a70-9fc7-47d5-9a59-946dd30c4a7a-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:41 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a Sep 17 15:16:41 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a Sep 17 15:16:42 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e54185b1-e4fe-49d4-9206-ab626f68aa4a" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-e54185b1-e4fe-49d4-9206-ab626f68aa4a" released by "delete_volume" :: held 0.849s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['34277320-a7a2-463a-9444-3c8cae8573e4', 'dad319b5-d5cc-4579-8a7a-7de82afbc905', 'ed97f1b9-c7c5-4c89-9e6d-a5d8bf59a8f6', 'b7c73e08-d863-4561-b4d7-7161c9038bd6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:42 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:42 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-0bd76e8a-20d1-4874-a3fa-24d56174958f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-0bd76e8a-20d1-4874-a3fa-24d56174958f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-0bd76e8a-20d1-4874-a3fa-24d56174958f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-0bd76e8a-20d1-4874-a3fa-24d56174958f" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691db0e-2461-41b7-b2e3-07d9d7a48678]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:43 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-076dad2f-9872-4dd0-ac07-3f7d694b2fcb tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-e54185b1-e4fe-49d4-9206-ab626f68aa4a-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:43 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f Sep 17 15:16:43 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:43 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f" returned: 0 in 0.479s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:43 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f Sep 17 15:16:43 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:43 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0bd76e8a-20d1-4874-a3fa-24d56174958f" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-0bd76e8a-20d1-4874-a3fa-24d56174958f" released by "delete_volume" :: held 0.949s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['02c891ad-ba10-46f2-9032-bd0b02e89a99', 'fa70268e-4f74-4364-bc65-ac095a483c4c', 'ace94a43-c949-41a8-a153-0cf805070fc7', 'd0580a60-e598-40cb-b391-006714e25ebb'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:44 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:44 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:44 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.326s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-709b16f9-4157-4ef1-99d4-3374210e47ee tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-0bd76e8a-20d1-4874-a3fa-24d56174958f-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-40086f45-36ba-4810-93b9-6fcdbeac693a-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-40086f45-36ba-4810-93b9-6fcdbeac693a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-40086f45-36ba-4810-93b9-6fcdbeac693a" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-40086f45-36ba-4810-93b9-6fcdbeac693a" acquired by "delete_volume" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6cf5e8-d6a4-46b8-bb39-ba0e42a367e3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:45 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a Sep 17 15:16:45 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:45 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a" returned: 0 in 0.496s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:45 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a Sep 17 15:16:45 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Flow 'volume_create_manager' (45b9298c-3f72-4944-85dc-cebc8afd3076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae60bd7-b0b4-4950-bfda-a90ec1e133c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae60bd7-b0b4-4950-bfda-a90ec1e133c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1114033876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e21a5e-cd18-4638-b362-21461e52b491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e220eabcd32a48f1903114be3b8d8697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:46Z,use_quota=True,user_id='85903c46329d44698de46317999aacb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beae4cdc-0e54-4591-a057-468e02c1c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:46 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beae4cdc-0e54-4591-a057-468e02c1c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031d3179-2a79-43e8-8ace-d51a234fb635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (031d3179-2a79-43e8-8ace-d51a234fb635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8e21a5e-cd18-4638-b362-21461e52b491', 'volume_name': 'volume-e8e21a5e-cd18-4638-b362-21461e52b491', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe40c6e-5ed2-4376-886c-be4d610c5f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfe40c6e-5ed2-4376-886c-be4d610c5f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46859e2a-3c63-4c3c-b5b5-962074fb4d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Volume e8e21a5e-cd18-4638-b362-21461e52b491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8e21a5e-cd18-4638-b362-21461e52b491', 'volume_size': 1} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1114033876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8e21a5e-cd18-4638-b362-21461e52b491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e220eabcd32a48f1903114be3b8d8697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:46Z,use_quota=True,user_id='85903c46329d44698de46317999aacb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Creating volume e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:46 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-40086f45-36ba-4810-93b9-6fcdbeac693a" returned: 0 in 0.774s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:46 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 1073741824 Sep 17 15:16:46 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-40086f45-36ba-4810-93b9-6fcdbeac693a" released by "delete_volume" :: held 1.336s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['d9c643e6-7597-48e3-b7d1-2a3d753737ad', '8f48ec60-f1f8-4358-b835-972f6a0e16bc', '6c802f45-96b4-414d-8dbf-b68aadf3a415', 'ae45f654-17fa-4e45-9b84-e3d205660eda'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:46 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:46 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:47 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:47 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 1073741824" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7379a5f7-8efa-4004-931b-ec25e2950354 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-40086f45-36ba-4810-93b9-6fcdbeac693a-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:47 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:16:47 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:47 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46859e2a-3c63-4c3c-b5b5-962074fb4d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8e21a5e-cd18-4638-b362-21461e52b491', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5a77ae-de0d-41aa-8024-132181fe305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Volume volume-e8e21a5e-cd18-4638-b362-21461e52b491 (e8e21a5e-cd18-4638-b362-21461e52b491): created successfully Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5a77ae-de0d-41aa-8024-132181fe305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Flow 'volume_create_manager' (45b9298c-3f72-4944-85dc-cebc8afd3076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f5137a01-6e91-4ee6-b1b1-0fe00d1d9a56 tempest-VolumeDependencyTests-515218934 None] Created volume successfully. Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-71ee16d1-37fc-43f6-810d-a492797d78f0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-71ee16d1-37fc-43f6-810d-a492797d78f0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-71ee16d1-37fc-43f6-810d-a492797d78f0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-71ee16d1-37fc-43f6-810d-a492797d78f0" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aec98b-51be-4215-a05d-aef28dd4de62]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:47 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 Sep 17 15:16:47 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:48 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:48 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0 Sep 17 15:16:48 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:48 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71ee16d1-37fc-43f6-810d-a492797d78f0" returned: 0 in 0.265s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-71ee16d1-37fc-43f6-810d-a492797d78f0" released by "delete_volume" :: held 0.738s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['6073ed81-eab4-4aac-8bac-19b0e55fb712', '0fabc7a8-9e7e-4171-831d-7e637d37136d', 'f06c1f60-35c0-409c-acb0-364796de9bdf', '70707cef-ab33-443f-9ca1-eb769ea466d9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:48 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:48 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-985da5cb-1220-461b-810d-f08ddb01c212-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-985da5cb-1220-461b-810d-f08ddb01c212-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-985da5cb-1220-461b-810d-f08ddb01c212" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-985da5cb-1220-461b-810d-f08ddb01c212" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleting offline snapshot 985da5cb-1220-461b-810d-f08ddb01c212 of volume 9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] snapshot_file for this snap is: volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:16:48 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0260f8-91db-496b-bbe3-d812b8089d5f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1cc57a35-6301-497f-b6b0-a5724fcdc250 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-71ee16d1-37fc-43f6-810d-a492797d78f0-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:48 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Creating offline snapshot 5dc2a129-d918-4364-9bea-9744b80fbdef of volume e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e8852-92e2-4928-89fb-3a27e7d951b9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 Sep 17 15:16:49 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (0b51f9e3-3370-459e-9935-61163693ba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52a238a-581d-436d-bfc8-baac4458b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52a238a-581d-436d-bfc8-baac4458b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049152854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc244491-3092-4ea3-a374-b95ff063f5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:49Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1b74af-2c1f-4af5-9e94-8d707f2f0e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f1b74af-2c1f-4af5-9e94-8d707f2f0e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca13296-dd12-4acb-aa97-e632c2d5f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca13296-dd12-4acb-aa97-e632c2d5f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc244491-3092-4ea3-a374-b95ff063f5b8', 'volume_name': 'volume-dc244491-3092-4ea3-a374-b95ff063f5b8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:16:49 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73053c20-8456-433e-9143-4a3e3054e36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73053c20-8456-433e-9143-4a3e3054e36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6f1c7-cae4-4258-ac07-ae5f81aef86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Volume dc244491-3092-4ea3-a374-b95ff063f5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc244491-3092-4ea3-a374-b95ff063f5b8', 'volume_size': 1} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:49 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c262b2f-2aac-49d6-9e52-10ea653fd549]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef 1G Sep 17 15:16:49 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f Sep 17 15:16:49 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 Sep 17 15:16:49 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Flow 'volume_create_manager' (0ad74fcf-6fd5-4f94-a319-cd4b6f133b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6bd55-53b6-4ff5-b38e-129f92a9466e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6bd55-53b6-4ff5-b38e-129f92a9466e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b93f4c1-2ffe-49f7-8a64-bbd99a786976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0d0ccafb4542218b0cad1b1845b8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:50Z,use_quota=True,user_id='6c02b84637374ce0bfad0e8e0320396d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3fbb0c-34cf-4865-9133-546045600abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe3fbb0c-34cf-4865-9133-546045600abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a448b1fb-3577-41f6-8019-94459b573efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG cinder.image.glance [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Creating Keystone auth plugin from conf {{(pid=85963) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 17 15:16:49 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef 1G" returned: 0 in 0.515s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e21a5e-cd18-4638-b362-21461e52b491 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:49 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e21a5e-cd18-4638-b362-21461e52b491 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:16:49 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a448b1fb-3577-41f6-8019-94459b573efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b93f4c1-2ffe-49f7-8a64-bbd99a786976', 'volume_name': 'volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976', 'volume_size': 1, 'image_id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b2c3473b06aca04d665c9461634689d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0d0ccafb4542218b0cad1b1845b8e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a46769c8af23ba9febefcce8f782ac557df48f6a598d48ea74ecb0783895bc4e44bf2bcb8cebb08778420dd76b43b7f9b911a13add2c220c2c0b09f85ac7db3', 'id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2080b7b2-58ae-4b8e-b5a2-7ca104d003a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2080b7b2-58ae-4b8e-b5a2-7ca104d003a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:50 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffdc6ca-982f-40aa-bb82-c8061888fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:50 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976', 'volume_size': 1, 'image_id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b2c3473b06aca04d665c9461634689d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0d0ccafb4542218b0cad1b1845b8e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a46769c8af23ba9febefcce8f782ac557df48f6a598d48ea74ecb0783895bc4e44bf2bcb8cebb08778420dd76b43b7f9b911a13add2c220c2c0b09f85ac7db3', 'id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99/file', 'properties': {}}, 'image_service': } Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Trying to clone 4b93f4c1-2ffe-49f7-8a64-bbd99a786976 from image ba3092eb-617d-4c0e-83ab-7f494d1afd99 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}]). {{(pid=85963) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212 Sep 17 15:16:50 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8e21a5e-cd18-4638-b362-21461e52b491 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.303s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef is being set with open permissions: ugo+rw Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 17 15:16:50 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Image download 0.00 MB at 0.00 MB/s Sep 17 15:16:50 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:16:50 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[778fabaa-1b8d-4cc9-8c83-b40be2630719]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:50 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f.985da5cb-1220-461b-810d-f08ddb01c212" returned: 0 in 0.264s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.252s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-985da5cb-1220-461b-810d-f08ddb01c212" released by "_delete_snapshot" :: held 1.669s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" released by "delete_snapshot" :: held 1.703s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info Sep 17 15:16:50 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['b510fbc2-2d64-4405-99b1-a38c7cebf7eb', '3b734840-1af2-45eb-a8a9-dc92391dc472', '3d245bf2-88d9-49e2-8e6c-3852473c3bf2', 'f3527c90-8449-4621-bd46-d5e8ed262de9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Delete snapshot completed successfully. Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-229d205f-b006-4ea9-ad7c-9a1832e8c14a tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-985da5cb-1220-461b-810d-f08ddb01c212-delete_snapshot" released by "delete_snapshot" :: held 1.892s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:50 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:50 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:50 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:50 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info is being set with open permissions: ugo+rw Sep 17 15:16:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:50 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info Sep 17 15:16:50 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:51 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 1 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Temporary image ba3092eb-617d-4c0e-83ab-7f494d1afd99 is fetched for user 6c02b84637374ce0bfad0e8e0320396d. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1967025a-597c-4414-9c6c-951b9ef1ec7b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.info" returned: 0 in 0.312s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.034s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049152854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc244491-3092-4ea3-a374-b95ff063f5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:49Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Creating volume dc244491-3092-4ea3-a374-b95ff063f5b8 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:51 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be88fc-e769-4ef3-85d9-c6e8ad304453]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 1073741824 Sep 17 15:16:51 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bc24d468-6048-4f4f-9219-d00d346e1a87 tempest-VolumeDependencyTests-515218934 None] Create snapshot completed successfully Sep 17 15:16:51 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f Sep 17 15:16:51 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:51 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f Sep 17 15:16:51 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 1073741824" returned: 0 in 0.461s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:51 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:51 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 Sep 17 15:16:51 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:51 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" returned: 0 in 0.271s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-quobyte-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f" released by "delete_volume" :: held 0.742s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Created reservations ['b701c1a9-47d2-4287-a7a7-932684a9cc43', '0ce8087c-c942-4a40-9b96-9a3973dbf1f7', 'a0e3332b-e956-44c1-a85f-46e4e75e31d0', '2e370c57-9578-4578-9f9e-5bdef31f0d74'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:51 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.057s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b93f4c1-2ffe-49f7-8a64-bbd99a786976,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af0d0ccafb4542218b0cad1b1845b8e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:50Z,use_quota=True,user_id='6c02b84637374ce0bfad0e8e0320396d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Creating volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:52 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1073741824 Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d6f1c7-cae4-4258-ac07-ae5f81aef86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc244491-3092-4ea3-a374-b95ff063f5b8', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762756d-a050-410e-8ae7-f111788519b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Volume volume-dc244491-3092-4ea3-a374-b95ff063f5b8 (dc244491-3092-4ea3-a374-b95ff063f5b8): created successfully Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9762756d-a050-410e-8ae7-f111788519b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:52 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (0b51f9e3-3370-459e-9935-61163693ba7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9d94b960-ed75-45ef-a336-9af12873a7aa tempest-ProjectReaderTests-834861004 None] Created volume successfully. Sep 17 15:16:52 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Deleted volume successfully. Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-34dda392-0039-4cf9-8e25-7493b85e5f59 tempest-CreateVolumesFromSnapshotTest-651177151 None] Lock "cinder-9e1a3cbf-dfdb-4e5c-9ccf-354b3204c31f-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:52 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1073741824" returned: 0 in 0.577s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Flow 'volume_create_manager' (8df42bf3-ea32-4e4f-9672-3eb5c3352b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377666e8-f995-4d4b-9191-bc7d45d4670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377666e8-f995-4d4b-9191-bc7d45d4670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1559543803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=562b3334-0265-491a-82a7-bbbd876aea8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e220eabcd32a48f1903114be3b8d8697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dc2a129-d918-4364-9bea-9744b80fbdef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:53Z,use_quota=True,user_id='85903c46329d44698de46317999aacb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3728d7cb-2fa6-4c8e-a60b-404e5aefc4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3728d7cb-2fa6-4c8e-a60b-404e5aefc4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709aecda-cee7-4747-88ce-b51d52002921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709aecda-cee7-4747-88ce-b51d52002921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '562b3334-0265-491a-82a7-bbbd876aea8e', 'volume_name': 'volume-562b3334-0265-491a-82a7-bbbd876aea8e', 'volume_size': 1, 'snapshot_id': '5dc2a129-d918-4364-9bea-9744b80fbdef'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c6f267-835b-42ca-b279-cbaf436cd0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67c6f267-835b-42ca-b279-cbaf436cd0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00f465c-337e-476c-ab41-ed50be871980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Volume 562b3334-0265-491a-82a7-bbbd876aea8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-562b3334-0265-491a-82a7-bbbd876aea8e', 'volume_size': 1, 'snapshot_id': '5dc2a129-d918-4364-9bea-9744b80fbdef'} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:52 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 Sep 17 15:16:52 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:52 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.273s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef-562b3334-0265-491a-82a7-bbbd876aea8e" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef-562b3334-0265-491a-82a7-bbbd876aea8e" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Creating volume 562b3334-0265-491a-82a7-bbbd876aea8e from snapshot 5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Attempting download of ba3092eb-617d-4c0e-83ab-7f494d1afd99 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}])) to volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] snapshot: 5dc2a129-d918-4364-9bea-9744b80fbdef, volume: 562b3334-0265-491a-82a7-bbbd876aea8e, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27549bbf-15dd-4a27-b612-6abff580aa85]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[21611887-0208-4c90-bfbc-ec5095020296]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:16:53 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:53 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t Sep 17 15:16:53 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-dc244491-3092-4ea3-a374-b95ff063f5b8-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "cinder-dc244491-3092-4ea3-a374-b95ff063f5b8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-quobyte-dc244491-3092-4ea3-a374-b95ff063f5b8" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-dc244491-3092-4ea3-a374-b95ff063f5b8" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:53 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t" returned: 0 in 0.451s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d69682-beee-4405-8a0d-bab6b2c8d0e4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.532s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e21a5e-cd18-4638-b362-21461e52b491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a789f0-dc68-40ec-abcd-c932ea3ec9ec]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:53 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t Sep 17 15:16:53 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:53 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 Sep 17 15:16:53 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:53 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:16:53 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t" returned: 1 in 0.447s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba3092eb-617d-4c0e-83ab-7f494d1afd99_rtsccr2t' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ea08e-6803-4593-9903-b7caafb95938]: (4, 'raw') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8" returned: 0 in 0.552s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8 Sep 17 15:16:54 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:54 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e Sep 17 15:16:54 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dc244491-3092-4ea3-a374-b95ff063f5b8" returned: 0 in 0.331s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-dc244491-3092-4ea3-a374-b95ff063f5b8" released by "delete_volume" :: held 0.946s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:54 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD Sep 17 15:16:54 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Created reservations ['288d8c83-ba5a-49d5-b533-203be200b661', 'edccc015-d7b0-422e-8d25-1077eb55d222', '35ba5552-6781-4aab-8bd1-de2a4fd13ab1', 'f6c29b8b-53b9-493b-b8f8-e331893ebfda'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:54 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:54 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD' failed. Not Retrying. {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] ba3092eb-617d-4c0e-83ab-7f494d1afd99 was raw, converting to qcow2 {{(pid=85963) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 17 15:16:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:54 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 Sep 17 15:16:54 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:55 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Deleted volume successfully. Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-b97e6ffc-9cd4-4e8d-92d5-dbce20781915 tempest-ProjectReaderTests-834861004 None] Lock "cinder-dc244491-3092-4ea3-a374-b95ff063f5b8-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:55 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" returned: 0 in 1.070s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba3092eb-617d-4c0e-83ab-7f494d1afd99_jn74fwl1devstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:16:55 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Converted 0.00 MB image at 0.00 MB/s Sep 17 15:16:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:55 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1G Sep 17 15:16:55 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:56 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 1G" returned: 0 in 0.766s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Downloaded image ba3092eb-617d-4c0e-83ab-7f494d1afd99 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}])) to volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976 successfully. {{(pid=85963) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Temporary image ba3092eb-617d-4c0e-83ab-7f494d1afd99 for user 6c02b84637374ce0bfad0e8e0320396d is deleted. {{(pid=85963) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.volume_utils [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Marking volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976 as bootable. {{(pid=85963) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Copying metadata from image ba3092eb-617d-4c0e-83ab-7f494d1afd99 to 4b93f4c1-2ffe-49f7-8a64-bbd99a786976. {{(pid=85963) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Creating volume glance metadata for volume 4b93f4c1-2ffe-49f7-8a64-bbd99a786976 backed by image ba3092eb-617d-4c0e-83ab-7f494d1afd99 with: {'image_id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6b2c3473b06aca04d665c9461634689d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=85963) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffdc6ca-982f-40aa-bb82-c8061888fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976', 'volume_size': 1, 'image_id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6b2c3473b06aca04d665c9461634689d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af0d0ccafb4542218b0cad1b1845b8e0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3a46769c8af23ba9febefcce8f782ac557df48f6a598d48ea74ecb0783895bc4e44bf2bcb8cebb08778420dd76b43b7f9b911a13add2c220c2c0b09f85ac7db3', 'id': 'ba3092eb-617d-4c0e-83ab-7f494d1afd99', 'created_at': datetime.datetime(2026, 9, 17, 13, 16, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 13, 16, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba3092eb-617d-4c0e-83ab-7f494d1afd99/file', 'properties': {}}, 'image_service': }' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf4e6ed-7825-48b0-a2ff-e8893133f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Volume volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 (4b93f4c1-2ffe-49f7-8a64-bbd99a786976): created successfully Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf4e6ed-7825-48b0-a2ff-e8893133f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Flow 'volume_create_manager' (0ad74fcf-6fd5-4f94-a319-cd4b6f133b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-15263d92-0445-4d45-a8da-1d9102f93dc5 tempest-VolumeImageDependencyTests-1617783575 None] Created volume successfully. Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:57 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:57 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Flow 'volume_create_manager' (953ffd83-231c-4622-8af2-497315e29fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d50758-7531-432d-bd91-90e7bf16cf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29d50758-7531-432d-bd91-90e7bf16cf58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e87e16-7bf2-413c-b386-51d1c39cedc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958bb53b85b448f8df09696ad8eecbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:57Z,use_quota=True,user_id='69a310a36b4f47d5919fd8110d87ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792996db-ffe5-4829-9325-51c2dcc6ef68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792996db-ffe5-4829-9325-51c2dcc6ef68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3ada2b-20f9-4c83-a09b-8dc4563324f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3ada2b-20f9-4c83-a09b-8dc4563324f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e87e16-7bf2-413c-b386-51d1c39cedc7', 'volume_name': 'volume-71e87e16-7bf2-413c-b386-51d1c39cedc7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aaaefd-45ad-46e4-b6c8-acd614f1f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2aaaefd-45ad-46e4-b6c8-acd614f1f64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363dc32d-ea58-4703-8458-3c7636fce0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Volume 71e87e16-7bf2-413c-b386-51d1c39cedc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e87e16-7bf2-413c-b386-51d1c39cedc7', 'volume_size': 1} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (68ebd6e4-122e-45ee-88fc-5bd99caf24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f93f71-4362-40ab-b3fa-6d7c619f29ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f93f71-4362-40ab-b3fa-6d7c619f29ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200775939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7750d7de-aa27-4b00-9fa6-0b14d00c095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:57Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4a8ad0-f5a7-4747-8063-25b3bf4d87cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4a8ad0-f5a7-4747-8063-25b3bf4d87cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4282d861-fb57-4dc3-be47-7107c6b01a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4282d861-fb57-4dc3-be47-7107c6b01a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7750d7de-aa27-4b00-9fa6-0b14d00c095f', 'volume_name': 'volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893c667f-d5d9-4317-b6be-b2a9b03b5f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (893c667f-d5d9-4317-b6be-b2a9b03b5f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce85a70e-c0ab-40f9-838e-dce8eaac7139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:16:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Volume 7750d7de-aa27-4b00-9fa6-0b14d00c095f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f', 'volume_size': 1} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:57 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Acquiring lock "cinder-4b93f4c1-2ffe-49f7-8a64-bbd99a786976-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "cinder-4b93f4c1-2ffe-49f7-8a64-bbd99a786976-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Acquiring lock "cinder-quobyte-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:16:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "cinder-quobyte-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" acquired by "delete_volume" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:16:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[69951cc2-2ff7-4081-8b29-6ccdb8edb3d1]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:16:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:58 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 Sep 17 15:16:58 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:58 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:58 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976 Sep 17 15:16:58 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:59 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" returned: 0 in 0.596s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "cinder-quobyte-4b93f4c1-2ffe-49f7-8a64-bbd99a786976" released by "delete_volume" :: held 1.195s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Created reservations ['05e7a8c5-4f05-43e1-a6a1-e7cd76eb9f90', '89395eac-f056-410e-97df-31006c336570', '0dd7e79d-ebbd-432c-ae3f-e6a99accea1f', '60d3e866-24f3-44a7-b36b-6ca030acb150'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:16:59 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:16:59 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:16:59 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:16:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Deleted volume successfully. Sep 17 15:16:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e34a6390-d532-4cb0-ab41-ebfd759c9034 tempest-VolumeImageDependencyTests-1617783575 None] Lock "cinder-4b93f4c1-2ffe-49f7-8a64-bbd99a786976-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:01 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e" returned: 0 in 7.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:17:01 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Converted 1024.00 MB image at 137.65 MB/s Sep 17 15:17:01 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e is being set with open permissions: ugo+rw Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:01 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e Sep 17 15:17:01 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:01 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" released by "_copy_volume_from_snapshot" :: held 8.899s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef-562b3334-0265-491a-82a7-bbbd876aea8e" released by "_create_volume_from_snapshot" :: held 8.982s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.732s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e87e16-7bf2-413c-b386-51d1c39cedc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958bb53b85b448f8df09696ad8eecbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:57Z,use_quota=True,user_id='69a310a36b4f47d5919fd8110d87ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Creating volume 71e87e16-7bf2-413c-b386-51d1c39cedc7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 1073741824 Sep 17 15:17:02 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00f465c-337e-476c-ab41-ed50be871980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-562b3334-0265-491a-82a7-bbbd876aea8e', 'volume_size': 1, 'snapshot_id': '5dc2a129-d918-4364-9bea-9744b80fbdef'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a47dcc5-b8f6-4951-818d-fd4c67636341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:02 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Volume volume-562b3334-0265-491a-82a7-bbbd876aea8e (562b3334-0265-491a-82a7-bbbd876aea8e): created successfully Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a47dcc5-b8f6-4951-818d-fd4c67636341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Flow 'volume_create_manager' (8df42bf3-ea32-4e4f-9672-3eb5c3352b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4b0f691f-6cc6-404f-b3e4-e17cdc0c3ffc tempest-VolumeDependencyTests-515218934 None] Created volume successfully. Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-5dc2a129-d918-4364-9bea-9744b80fbdef-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-5dc2a129-d918-4364-9bea-9744b80fbdef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:02 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 1073741824" returned: 0 in 0.550s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" acquired by "delete_snapshot" :: waited 0.028s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Deleting offline snapshot 5dc2a129-d918-4364-9bea-9744b80fbdef of volume e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:02 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 Sep 17 15:17:02 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] snapshot_file for this snap is: volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd405f8-3331-4796-b0cf-ed8c019e6a1b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:17:02 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7" returned: 0 in 0.299s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.483s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200775939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7750d7de-aa27-4b00-9fa6-0b14d00c095f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:16:57Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Creating volume 7750d7de-aa27-4b00-9fa6-0b14d00c095f {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:02 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (363dc32d-ea58-4703-8458-3c7636fce0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e87e16-7bf2-413c-b386-51d1c39cedc7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:02 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f 1073741824 Sep 17 15:17:02 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:02 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61344821-0c92-43b5-85cd-f50633fcdd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Volume volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 (71e87e16-7bf2-413c-b386-51d1c39cedc7): created successfully Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61344821-0c92-43b5-85cd-f50633fcdd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Flow 'volume_create_manager' (953ffd83-231c-4622-8af2-497315e29fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1a4e3587-3a12-4eb9-bbcc-fc669f8b0b10 tempest-CinderUnicodeTest-474977431 None] Created volume successfully. Sep 17 15:17:03 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.412s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8e21a5e-cd18-4638-b362-21461e52b491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f176e-dc0b-4778-bb5f-916fa8993588]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:03 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:17:03 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:03 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f 1073741824" returned: 0 in 0.564s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:03 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f Sep 17 15:17:03 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:03 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.756s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:03 devstack sudo[103229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:17:03 devstack sudo[103229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:03 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce85a70e-c0ab-40f9-838e-dce8eaac7139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f63f4-6aa6-49ae-8961-aa97a96d9a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:03 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Volume volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f (7750d7de-aa27-4b00-9fa6-0b14d00c095f): created successfully Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f63f4-6aa6-49ae-8961-aa97a96d9a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:03 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (68ebd6e4-122e-45ee-88fc-5bd99caf24c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-28b49655-7d58-44ee-bc62-c96aa70b3415 tempest-ProjectReaderTests-834861004 None] Created volume successfully. Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Flow 'volume_create_manager' (59d27a1c-442f-455b-b4a9-0a947e904f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1e11b-6bfe-4fab-b263-52327e003715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1e11b-6bfe-4fab-b263-52327e003715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-172922710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280497ac-3b4f-4106-ae86-62fff52350a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958bb53b85b448f8df09696ad8eecbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:04Z,use_quota=True,user_id='69a310a36b4f47d5919fd8110d87ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb1c7c7-d957-4878-bcfd-52f771805397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb1c7c7-d957-4878-bcfd-52f771805397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b38b47-8610-466a-83a6-50b92dd06ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3b38b47-8610-466a-83a6-50b92dd06ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '280497ac-3b4f-4106-ae86-62fff52350a2', 'volume_name': 'volume-280497ac-3b4f-4106-ae86-62fff52350a2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb74c1d-bebb-4de3-bc3e-fcadcc735475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb74c1d-bebb-4de3-bc3e-fcadcc735475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62b5c88-7993-4444-8ea8-07c7d828e2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:04 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Volume 280497ac-3b4f-4106-ae86-62fff52350a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-280497ac-3b4f-4106-ae86-62fff52350a2', 'volume_size': 1} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:04Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-172922710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=280497ac-3b4f-4106-ae86-62fff52350a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2958bb53b85b448f8df09696ad8eecbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:04Z,use_quota=True,user_id='69a310a36b4f47d5919fd8110d87ecb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Creating volume 280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:04 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 1073741824 Sep 17 15:17:04 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack sudo[103229]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.429s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef Sep 17 15:17:04 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-7750d7de-aa27-4b00-9fa6-0b14d00c095f-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "cinder-7750d7de-aa27-4b00-9fa6-0b14d00c095f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:04 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491.5dc2a129-d918-4364-9bea-9744b80fbdef" returned: 0 in 0.340s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-quobyte-7750d7de-aa27-4b00-9fa6-0b14d00c095f" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:04 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 1073741824" returned: 0 in 0.584s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-5dc2a129-d918-4364-9bea-9744b80fbdef" released by "_delete_snapshot" :: held 2.104s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-7750d7de-aa27-4b00-9fa6-0b14d00c095f" acquired by "delete_volume" :: waited 0.057s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" released by "delete_snapshot" :: held 2.166s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880e1fd-499c-45fd-925f-acc5b4ff0f6b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:04 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 Sep 17 15:17:04 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Created reservations ['a349aca1-128b-4fd8-b383-407d0eececb8', '2f4e3d62-a79e-4399-88b2-bb85ee286cc5', 'c2100098-2808-4c4d-bd80-658d161fd90f', 'a1aea5d0-a701-4e82-820c-17a1336c1bc4'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:04 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f Sep 17 15:17:04 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Delete snapshot completed successfully. Sep 17 15:17:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-94ee6789-5941-4f4b-91fd-0baf69a81c66 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-5dc2a129-d918-4364-9bea-9744b80fbdef-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:05 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62b5c88-7993-4444-8ea8-07c7d828e2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-280497ac-3b4f-4106-ae86-62fff52350a2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ff5da2-28eb-4632-a6dd-2a049c55a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Volume volume-280497ac-3b4f-4106-ae86-62fff52350a2 (280497ac-3b4f-4106-ae86-62fff52350a2): created successfully Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ff5da2-28eb-4632-a6dd-2a049c55a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Flow 'volume_create_manager' (59d27a1c-442f-455b-b4a9-0a947e904f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:05 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4680dea4-ac37-4331-aa31-5442843ec6a0 tempest-CinderUnicodeTest-474977431 None] Created volume successfully. Sep 17 15:17:05 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f" returned: 0 in 0.448s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:05 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f Sep 17 15:17:05 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:05 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-7750d7de-aa27-4b00-9fa6-0b14d00c095f" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-7750d7de-aa27-4b00-9fa6-0b14d00c095f" released by "delete_volume" :: held 0.777s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Created reservations ['60f01471-7921-457b-8146-42d167357161', '0f96425f-4892-45c2-ae15-3e26f44574fb', 'b0e13260-fc3b-487d-86e6-66ededde0749', '1ce38f1c-d697-4c24-83e6-7d7d7a73b829'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:05 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:05 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-e8e21a5e-cd18-4638-b362-21461e52b491-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-e8e21a5e-cd18-4638-b362-21461e52b491-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:05 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Deleted volume successfully. Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[093dc548-6cb8-4cd3-8b61-7488cedbd9bd]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-26f7ff03-46b5-45ff-ad9d-8604ea616e47 tempest-ProjectReaderTests-834861004 None] Lock "cinder-7750d7de-aa27-4b00-9fa6-0b14d00c095f-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:06 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:17:06 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (16f2cea6-038f-46e6-b92c-607366e41e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a525207-f0a5-4302-9916-86612fcb75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a525207-f0a5-4302-9916-86612fcb75f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613094087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17f08f4-1037-4be7-bbed-17341c887ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:06Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a0801a-dd94-4d7b-a7c8-15b3b6c8e7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a0801a-dd94-4d7b-a7c8-15b3b6c8e7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:06 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349612a3-8fba-4bca-90fc-445089d76def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349612a3-8fba-4bca-90fc-445089d76def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17f08f4-1037-4be7-bbed-17341c887ee0', 'volume_name': 'volume-e17f08f4-1037-4be7-bbed-17341c887ee0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87141b11-0ebd-4c92-b3e9-2b0f981c10bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87141b11-0ebd-4c92-b3e9-2b0f981c10bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a048dc-2542-4cb6-b03e-f6819cbabf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Volume e17f08f4-1037-4be7-bbed-17341c887ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17f08f4-1037-4be7-bbed-17341c887ee0', 'volume_size': 1} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613094087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17f08f4-1037-4be7-bbed-17341c887ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:06Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Creating volume e17f08f4-1037-4be7-bbed-17341c887ee0 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:06 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 1073741824 Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.532s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:06 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:06 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491 Sep 17 15:17:06 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:06 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e8e21a5e-cd18-4638-b362-21461e52b491" returned: 0 in 0.282s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-e8e21a5e-cd18-4638-b362-21461e52b491" released by "delete_volume" :: held 0.920s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Created reservations ['6a1e561e-bd61-4934-ae32-1981148d43db', '52dac2a6-ff07-463b-bff2-c09a843985b6', '19a25a96-1549-4f21-958b-c386781b0cd5', '4a0bd646-cec3-431f-a0e3-cc39d9023be9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:07 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:07 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 1073741824" returned: 0 in 0.554s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 Sep 17 15:17:07 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:07 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Deleted volume successfully. Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c122e56-4d00-4eb4-865d-084ed29165b2 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-e8e21a5e-cd18-4638-b362-21461e52b491-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:07 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.825s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87a048dc-2542-4cb6-b03e-f6819cbabf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17f08f4-1037-4be7-bbed-17341c887ee0', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bcfb13-ed75-4690-990c-ddaa7d64faac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Creating offline snapshot edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 of volume 280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Volume volume-e17f08f4-1037-4be7-bbed-17341c887ee0 (e17f08f4-1037-4be7-bbed-17341c887ee0): created successfully Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bcfb13-ed75-4690-990c-ddaa7d64faac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (16f2cea6-038f-46e6-b92c-607366e41e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2efa53f-f5d1-4300-a07b-d688920455d2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1e9302f8-f35d-4606-afbb-f8c9cdb27139 tempest-ProjectReaderTests-834861004 None] Created volume successfully. Sep 17 15:17:07 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 Sep 17 15:17:07 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:07 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2" returned: 0 in 0.426s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:07 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 1G Sep 17 15:17:07 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-562b3334-0265-491a-82a7-bbbd876aea8e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-562b3334-0265-491a-82a7-bbbd876aea8e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee44983-8262-4bc2-b157-617eb4e7b5cf]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e Sep 17 15:17:08 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 1G" returned: 0 in 0.517s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280497ac-3b4f-4106-ae86-62fff52350a2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack sudo[103292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280497ac-3b4f-4106-ae86-62fff52350a2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 Sep 17 15:17:08 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-e17f08f4-1037-4be7-bbed-17341c887ee0-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "cinder-e17f08f4-1037-4be7-bbed-17341c887ee0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-quobyte-e17f08f4-1037-4be7-bbed-17341c887ee0" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:08 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e" returned: 0 in 0.506s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-e17f08f4-1037-4be7-bbed-17341c887ee0" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:08 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e Sep 17 15:17:08 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4608f36a-828f-44da-8b11-23d4ee944f6a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-280497ac-3b4f-4106-ae86-62fff52350a2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:08 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 is being set with open permissions: ugo+rw Sep 17 15:17:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:08 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 Sep 17 15:17:08 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:08 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 Sep 17 15:17:08 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-562b3334-0265-491a-82a7-bbbd876aea8e" returned: 0 in 0.307s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-quobyte-562b3334-0265-491a-82a7-bbbd876aea8e" released by "delete_volume" :: held 0.877s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Created reservations ['fab5a8df-2508-459a-972d-f29d9d60f7b6', 'd0868bdf-5dbe-436f-85ec-63c2e5cdd6eb', 'cd301063-ca5d-4bcb-acb3-694ab5592deb', '79a3a9e1-6c63-40b4-8d1e-fd2d4fcde942'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:09 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:09 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info Sep 17 15:17:09 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0" returned: 0 in 0.500s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:09 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:09 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0 Sep 17 15:17:09 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info is being set with open permissions: ugo+rw Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:09 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info Sep 17 15:17:09 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.398s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Deleted volume successfully. Sep 17 15:17:09 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-e17f08f4-1037-4be7-bbed-17341c887ee0" returned: 0 in 0.411s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-e17f08f4-1037-4be7-bbed-17341c887ee0" released by "delete_volume" :: held 0.974s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-e931a057-9cbe-495c-bd92-1088d7924ba0 tempest-VolumeDependencyTests-515218934 None] Lock "cinder-562b3334-0265-491a-82a7-bbbd876aea8e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Created reservations ['359a8535-8862-4fef-bc17-32d82624fa2c', 'c602d610-5f4d-4db5-b16f-e374383a6b98', '448e669f-517b-4dc5-9fdc-16061a68d011', 'bcfe106a-15d2-49c8-8fa7-313942d405b1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:09 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:09 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:09 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.info" returned: 0 in 0.431s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.548s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c9066024-9aa2-488e-952a-dad19bbda8c6 tempest-CinderUnicodeTest-474977431 None] Create snapshot completed successfully Sep 17 15:17:10 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:10 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Deleted volume successfully. Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-6e8c751a-9663-43c7-b507-dae2d9953105 tempest-ProjectReaderTests-834861004 None] Lock "cinder-e17f08f4-1037-4be7-bbed-17341c887ee0-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-quobyte-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Deleting offline snapshot edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 of volume 280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] snapshot_file for this snap is: volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c558839-bc3f-4c60-9dd2-c28f1d5a1e9a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:10 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (29a987c1-004d-4fe9-8008-c7bf81e0feb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ee57b6-1061-4550-b2bb-25834ba85981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ee57b6-1061-4550-b2bb-25834ba85981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999871540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ae402d-54f1-4c6b-be88-fe47c0079627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:11Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e01fabb-ba82-40a0-a2f9-2e41be626c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e01fabb-ba82-40a0-a2f9-2e41be626c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca663ec7-800a-4f93-bf07-4a1ae04a3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca663ec7-800a-4f93-bf07-4a1ae04a3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04ae402d-54f1-4c6b-be88-fe47c0079627', 'volume_name': 'volume-04ae402d-54f1-4c6b-be88-fe47c0079627', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96352d90-f997-4143-9c29-1684693d7b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96352d90-f997-4143-9c29-1684693d7b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a1004d-e55f-4c8d-902e-290887fbd39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Volume 04ae402d-54f1-4c6b-be88-fe47c0079627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04ae402d-54f1-4c6b-be88-fe47c0079627', 'volume_size': 1} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999871540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ae402d-54f1-4c6b-be88-fe47c0079627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:11Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Creating volume 04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:11 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 Sep 17 15:17:11 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 1073741824 Sep 17 15:17:11 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" returned: 0 in 0.511s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-280497ac-3b4f-4106-ae86-62fff52350a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[555863c0-e276-4b9f-8224-c118998dee3f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (233ec921-66f1-4c40-a730-842b9b6ecb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b5f539-137b-4a92-8f6a-80f03b8658c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20b5f539-137b-4a92-8f6a-80f03b8658c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175403313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76851011-11d5-42b5-98d1-3617f65f58ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:12Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9493c941-fba0-4400-9116-e984fcdbee89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9493c941-fba0-4400-9116-e984fcdbee89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 Sep 17 15:17:11 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a74ea2-06a4-4cfa-9385-e6c94e6ad3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a74ea2-06a4-4cfa-9385-e6c94e6ad3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76851011-11d5-42b5-98d1-3617f65f58ce', 'volume_name': 'volume-76851011-11d5-42b5-98d1-3617f65f58ce', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f4d6e1-5a52-4b76-a58c-4bbc175957e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f4d6e1-5a52-4b76-a58c-4bbc175957e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8422c13-005d-444d-bb75-130b18e4e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:11 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Volume 76851011-11d5-42b5-98d1-3617f65f58ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76851011-11d5-42b5-98d1-3617f65f58ce', 'volume_size': 1} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:11 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 1073741824" returned: 0 in 0.616s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:11 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 Sep 17 15:17:11 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:11 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2" returned: 0 in 0.452s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:12 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 Sep 17 15:17:12 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:12 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627" returned: 0 in 0.294s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1175403313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76851011-11d5-42b5-98d1-3617f65f58ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc95e96d2d4248abbb5bd8290165d696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:12Z,use_quota=True,user_id='8c27bbc6857345a2a3f2da6e4fcadeb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Creating volume 76851011-11d5-42b5-98d1-3617f65f58ce {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:12 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a1004d-e55f-4c8d-902e-290887fbd39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ae402d-54f1-4c6b-be88-fe47c0079627', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:12 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce 1073741824 Sep 17 15:17:12 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111be430-bcbd-46fe-8ef5-088957b603f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Volume volume-04ae402d-54f1-4c6b-be88-fe47c0079627 (04ae402d-54f1-4c6b-be88-fe47c0079627): created successfully Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111be430-bcbd-46fe-8ef5-088957b603f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (29a987c1-004d-4fe9-8008-c7bf81e0feb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2fed0bba-562b-4d11-be40-9be20e29ab93 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:17:12 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:12 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23 Sep 17 15:17:12 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:12 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce 1073741824" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2.edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:12 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce Sep 17 15:17:12 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23" released by "_delete_snapshot" :: held 1.802s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" released by "delete_snapshot" :: held 1.828s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Created reservations ['0ef30b35-1f00-4c68-a7a8-282758de568f', 'bce372c4-db06-45ed-928b-396bc9363e8b', '68491f06-0e71-4ece-8f0e-fb285bdb1c19', 'f08aa0f2-23fa-4325-8ba1-ccd8b82c60ec'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Delete snapshot completed successfully. Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3c3aa3c9-554f-452d-bd18-b924f5746ebe tempest-CinderUnicodeTest-474977431 None] Lock "cinder-edd6c1d5-df07-4db6-880b-ae2d0cfdbd23-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:12 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8422c13-005d-444d-bb75-130b18e4e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76851011-11d5-42b5-98d1-3617f65f58ce', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:12 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b5fbfa-c6da-4e0d-baac-2e7d307d8722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:12 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Volume volume-76851011-11d5-42b5-98d1-3617f65f58ce (76851011-11d5-42b5-98d1-3617f65f58ce): created successfully Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b5fbfa-c6da-4e0d-baac-2e7d307d8722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Flow 'volume_create_manager' (233ec921-66f1-4c40-a730-842b9b6ecb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-5c59bb80-7059-453d-a29c-85a71e80e31b tempest-ProjectReaderTests-834861004 None] Created volume successfully. Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-280497ac-3b4f-4106-ae86-62fff52350a2-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "cinder-280497ac-3b4f-4106-ae86-62fff52350a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e050561-807a-4726-9938-2fb6957b05aa]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 Sep 17 15:17:13 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 87781dbd-cef2-4902-abd7-feee29f4ac0c of volume 04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a07739-dda5-4c04-9bf1-4c052ebeb3c4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2" returned: 0 in 0.456s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2 Sep 17 15:17:13 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:13 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 Sep 17 15:17:13 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-76851011-11d5-42b5-98d1-3617f65f58ce-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "cinder-76851011-11d5-42b5-98d1-3617f65f58ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Acquiring lock "cinder-quobyte-76851011-11d5-42b5-98d1-3617f65f58ce" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-76851011-11d5-42b5-98d1-3617f65f58ce" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e814ef5f-91d7-4256-a584-e4c03922bcee]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:13 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-280497ac-3b4f-4106-ae86-62fff52350a2" returned: 0 in 0.310s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-280497ac-3b4f-4106-ae86-62fff52350a2" released by "delete_volume" :: held 0.843s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:13 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce Sep 17 15:17:13 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627" returned: 0 in 0.527s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Created reservations ['4f240289-95ac-40f3-9c12-3919f67d7253', 'a410be5f-0145-484c-8c9d-abb7075e1dff', '11614df4-17a4-4ea4-8ff9-774756fbd978', '3c5b8135-4562-42ee-8fac-57821d802e37'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:14 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c 1G Sep 17 15:17:14 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:14 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-71e87e16-7bf2-413c-b386-51d1c39cedc7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce" returned: 0 in 0.501s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "cinder-71e87e16-7bf2-413c-b386-51d1c39cedc7-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:14 devstack sudo[103391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce Sep 17 15:17:14 devstack sudo[103391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "cinder-quobyte-71e87e16-7bf2-413c-b386-51d1c39cedc7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-71e87e16-7bf2-413c-b386-51d1c39cedc7" acquired by "delete_volume" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5e2da4-1686-48fe-a5d3-ed057af3cd78]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:14 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Deleted volume successfully. Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-4112740c-2c47-40a0-851b-8b5e2e019dcf tempest-CinderUnicodeTest-474977431 None] Lock "cinder-280497ac-3b4f-4106-ae86-62fff52350a2-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:14 devstack sudo[103397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 Sep 17 15:17:14 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack sudo[103391]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-76851011-11d5-42b5-98d1-3617f65f58ce" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "cinder-quobyte-76851011-11d5-42b5-98d1-3617f65f58ce" released by "delete_volume" :: held 0.985s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:14 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c 1G" returned: 0 in 0.720s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ae402d-54f1-4c6b-be88-fe47c0079627 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:14 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ae402d-54f1-4c6b-be88-fe47c0079627 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c Sep 17 15:17:14 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Created reservations ['9824286c-8e40-409d-ba27-1d86e6ab946a', 'd84673e7-d30e-4e46-ba5f-0cb93dfeea38', 'c2f0de7e-56d8-4d5f-8bf1-1c8da4af1298', '863dd0be-529b-4d5b-b0d3-b41674cfd1c6'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:15 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7" returned: 0 in 0.522s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7 Sep 17 15:17:15 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04ae402d-54f1-4c6b-be88-fe47c0079627 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c" returned: 0 in 0.427s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c is being set with open permissions: ugo+rw Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c Sep 17 15:17:15 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Deleted volume successfully. Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-9177575e-d8da-4f66-a133-3beb0debd641 tempest-ProjectReaderTests-834861004 None] Lock "cinder-76851011-11d5-42b5-98d1-3617f65f58ce-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:15 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-71e87e16-7bf2-413c-b386-51d1c39cedc7" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "cinder-quobyte-71e87e16-7bf2-413c-b386-51d1c39cedc7" released by "delete_volume" :: held 0.932s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Created reservations ['89038bb3-0b52-4ed3-b2aa-6b6d16127f51', 'e6d8e66a-6584-4229-8f49-3c8354c5a037', '802d32c1-ffd7-4bc4-ae97-903ced3fa77c', '9d7e5d03-64ed-4a27-8e6d-5727bbc6c216'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:15 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info Sep 17 15:17:15 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:15 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info is being set with open permissions: ugo+rw Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:15 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Deleted volume successfully. Sep 17 15:17:15 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info Sep 17 15:17:15 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:15 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-41bca631-93e0-4a2c-8437-c527c5a35018 tempest-CinderUnicodeTest-474977431 None] Lock "cinder-71e87e16-7bf2-413c-b386-51d1c39cedc7-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:16 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.info" returned: 0 in 0.296s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=229,cinder:UPDATE=307,cinder:DELETE=32,cinder:INSERT=88 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=240,cinder:UPDATE=344,cinder:INSERT=83,cinder:DELETE=26 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:17:16 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-4cd141b1-db98-42f3-a01c-915ee1b28db4 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-87781dbd-cef2-4902-abd7-feee29f4ac0c-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-87781dbd-cef2-4902-abd7-feee29f4ac0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-87781dbd-cef2-4902-abd7-feee29f4ac0c" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-87781dbd-cef2-4902-abd7-feee29f4ac0c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 87781dbd-cef2-4902-abd7-feee29f4ac0c of volume 04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[295fbdc6-ff27-4697-88a7-4e93cb985c99]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:16 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c Sep 17 15:17:16 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:17 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c" returned: 0 in 0.555s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04ae402d-54f1-4c6b-be88-fe47c0079627(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bee2f51-6cfd-40a0-a669-a63ecd6a63f0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:17 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 Sep 17 15:17:17 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:17 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627" returned: 0 in 0.533s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:17 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c Sep 17 15:17:17 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:18 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c" returned: 0 in 0.623s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:18 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c Sep 17 15:17:18 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:18 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627.87781dbd-cef2-4902-abd7-feee29f4ac0c" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-87781dbd-cef2-4902-abd7-feee29f4ac0c" released by "_delete_snapshot" :: held 2.169s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:18 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" released by "delete_snapshot" :: held 2.199s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Created reservations ['31863838-61f7-407f-88f7-3094b26819bb', '62ddaa88-20ea-4281-b18f-ca530b0271d4', '8151d947-115a-4989-a8be-583a4037de18', '0d54e245-b442-4e78-b9b2-06068e9114fe'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:17:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-7734274c-890d-4fa7-b73a-eec8d5ea94b9 tempest-ProjectMemberTests-150498844 None] Lock "cinder-87781dbd-cef2-4902-abd7-feee29f4ac0c-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-04ae402d-54f1-4c6b-be88-fe47c0079627-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "cinder-04ae402d-54f1-4c6b-be88-fe47c0079627-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" acquired by "delete_volume" :: waited 0.031s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b9401-0cc9-41e2-8fee-64b0a898521d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:20 devstack sudo[103447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 Sep 17 15:17:20 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:20 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627" returned: 0 in 0.507s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:20 devstack sudo[103452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627 Sep 17 15:17:20 devstack sudo[103452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[103452]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-04ae402d-54f1-4c6b-be88-fe47c0079627" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-04ae402d-54f1-4c6b-be88-fe47c0079627" released by "delete_volume" :: held 1.014s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Created reservations ['98e8c63f-f2d1-4134-a5a2-bd722de5a1cf', '4d9a4f0c-d4a6-4041-9fda-04e145e3e78d', '9eeb05c1-9f9d-4a04-b327-14a5e3abbd9a', '5a58aa04-f9ed-448f-9004-610d00e71431'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:21 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:21 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:21 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.328s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:17:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-978ea749-4d8f-4023-a05b-a65cbb519cfb tempest-ProjectMemberTests-150498844 None] Lock "cinder-04ae402d-54f1-4c6b-be88-fe47c0079627-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (b2df79f5-6e28-42ba-8ef4-9dad0b22fecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adec7ec-2adb-4834-a670-5b3ce89cc8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3adec7ec-2adb-4834-a670-5b3ce89cc8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141355612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc25b58-8fc5-4b3b-8216-483bef5e52c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:23Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ad3542-b7e8-4ee6-bf7c-0c0479b2de1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ad3542-b7e8-4ee6-bf7c-0c0479b2de1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90d4b88-cb8c-489f-9e38-72eedcc1038d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e90d4b88-cb8c-489f-9e38-72eedcc1038d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc25b58-8fc5-4b3b-8216-483bef5e52c3', 'volume_name': 'volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4606f074-fb9a-423e-b85a-cfe45b0c24e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4606f074-fb9a-423e-b85a-cfe45b0c24e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44be7dc2-428f-4b94-820d-35c5a8f709a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Volume 1fc25b58-8fc5-4b3b-8216-483bef5e52c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3', 'volume_size': 1} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141355612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc25b58-8fc5-4b3b-8216-483bef5e52c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:23Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Creating volume 1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:22 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:22 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 1073741824 Sep 17 15:17:22 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 1073741824" returned: 0 in 0.661s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:23 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 Sep 17 15:17:23 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:23 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" returned: 0 in 0.315s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44be7dc2-428f-4b94-820d-35c5a8f709a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df00d1-fb93-4aa8-9671-1ccdb7a178f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:23 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Volume volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 (1fc25b58-8fc5-4b3b-8216-483bef5e52c3): created successfully Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84df00d1-fb93-4aa8-9671-1ccdb7a178f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:23 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (b2df79f5-6e28-42ba-8ef4-9dad0b22fecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-7ae85d17-4851-4b9c-977e-8bc336f1aa12 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 216b4310-dbe0-4cad-a79b-f905d1edb1c6 of volume 1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[726afa7b-129b-4217-b9d6-f367d40e2db4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:25 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 Sep 17 15:17:25 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:25 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" returned: 0 in 0.481s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:25 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 1G Sep 17 15:17:25 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:26 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 1G" returned: 0 in 0.678s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:26 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 Sep 17 15:17:26 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:26 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6" returned: 0 in 0.517s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:26 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 is being set with open permissions: ugo+rw Sep 17 15:17:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:26 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 Sep 17 15:17:26 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:27 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:27 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info Sep 17 15:17:27 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:27 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info" returned: 0 in 0.381s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:27 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info is being set with open permissions: ugo+rw Sep 17 15:17:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:27 devstack sudo[103490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info Sep 17 15:17:27 devstack sudo[103490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:27 devstack sudo[103490]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.info" returned: 0 in 0.385s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-224a66a4-e5cb-483d-af40-8c1894a7efad tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-216b4310-dbe0-4cad-a79b-f905d1edb1c6-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-216b4310-dbe0-4cad-a79b-f905d1edb1c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-216b4310-dbe0-4cad-a79b-f905d1edb1c6" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-216b4310-dbe0-4cad-a79b-f905d1edb1c6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 216b4310-dbe0-4cad-a79b-f905d1edb1c6 of volume 1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[495b3764-f721-432e-a676-676e94ae75c1]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:28 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 Sep 17 15:17:28 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:29 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6" returned: 0 in 0.583s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaddebb-4b8b-4fc9-894b-ae123364f0dc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:29 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 Sep 17 15:17:29 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:29 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" returned: 0 in 0.559s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:29 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 Sep 17 15:17:29 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:30 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6" returned: 0 in 0.477s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:30 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6 Sep 17 15:17:30 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:30 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3.216b4310-dbe0-4cad-a79b-f905d1edb1c6" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-216b4310-dbe0-4cad-a79b-f905d1edb1c6" released by "_delete_snapshot" :: held 2.082s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" released by "delete_snapshot" :: held 2.112s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Created reservations ['48ddbc3d-c60c-4f64-b478-62d5c2b01847', 'e7d476aa-d227-422c-8fc5-8d4877a5fd8b', 'c7e65819-3de4-4d33-b9eb-f4d1c1835945', '041f4d09-4341-46c9-9fa7-40105e766b50'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:30 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:17:30 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-393fb57e-ffdd-4ceb-9511-4dd70070f575 tempest-ProjectMemberTests-150498844 None] Lock "cinder-216b4310-dbe0-4cad-a79b-f905d1edb1c6-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-1fc25b58-8fc5-4b3b-8216-483bef5e52c3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "cinder-1fc25b58-8fc5-4b3b-8216-483bef5e52c3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ff300-284f-47b2-8ab5-d827d0df9792]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 Sep 17 15:17:32 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" returned: 0 in 0.462s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:32 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3 Sep 17 15:17:32 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:32 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" returned: 0 in 0.389s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1fc25b58-8fc5-4b3b-8216-483bef5e52c3" released by "delete_volume" :: held 0.959s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:32 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Created reservations ['cc73a830-437f-48a4-a62e-45919f5ec2a0', 'b79fa358-2a36-41f1-a94b-2eb520d6ea6f', 'b6b3dbec-828a-4fe6-9b82-e1baf64ee269', '8efa0e4a-575c-44d0-bbc9-85dd34adc391'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:33 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:33 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.321s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1f2f9705-a5c2-44a7-b0be-89a1a181102e tempest-ProjectMemberTests-150498844 None] Lock "cinder-1fc25b58-8fc5-4b3b-8216-483bef5e52c3-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (241b5951-1fc6-4a7b-bd5a-b58e9a9a5773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbfea61-1166-4b45-8f80-fa4fdc78dd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbfea61-1166-4b45-8f80-fa4fdc78dd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673587773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32299b4c-5742-46ca-8eec-9cbb65ff7f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:34Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d866c6-bd8f-4413-aea1-bd36a5303844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44d866c6-bd8f-4413-aea1-bd36a5303844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb3788-ec31-4f11-a909-735c1cdc4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65eb3788-ec31-4f11-a909-735c1cdc4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32299b4c-5742-46ca-8eec-9cbb65ff7f00', 'volume_name': 'volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23072070-6a20-4837-809d-3376b0ad511e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23072070-6a20-4837-809d-3376b0ad511e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f1056-978a-4250-8afa-39720a6793ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:33 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Volume 32299b4c-5742-46ca-8eec-9cbb65ff7f00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00', 'volume_size': 1} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-673587773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32299b4c-5742-46ca-8eec-9cbb65ff7f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:34Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Creating volume 32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:33 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:33 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 1073741824 Sep 17 15:17:33 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:34 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 1073741824" returned: 0 in 0.561s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:34 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 Sep 17 15:17:34 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:34 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f7f1056-978a-4250-8afa-39720a6793ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0916826a-73d6-4260-971e-43dce85d911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:34 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Volume volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 (32299b4c-5742-46ca-8eec-9cbb65ff7f00): created successfully Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0916826a-73d6-4260-971e-43dce85d911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:34 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (241b5951-1fc6-4a7b-bd5a-b58e9a9a5773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:34 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-9ad06d79-0619-4fa5-bb17-25059407209d tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Flow 'volume_create_manager' (7b441edb-8bfc-49bd-932c-2fc4b285a076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f033bdba-8709-457a-a462-68ff110b388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f033bdba-8709-457a-a462-68ff110b388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078518382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f725c65f-265e-47a2-beb0-edff74f461e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125eabb716144e2588f1ddcfa34d6591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:35Z,use_quota=True,user_id='0ec904c239d44d9db15157254c1aca8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96a5be9-daf6-483d-882a-0f44b532b2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96a5be9-daf6-483d-882a-0f44b532b2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6609700d-5629-48a7-8f2a-460e39803ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6609700d-5629-48a7-8f2a-460e39803ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f725c65f-265e-47a2-beb0-edff74f461e7', 'volume_name': 'volume-f725c65f-265e-47a2-beb0-edff74f461e7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3b4e08-aa4f-408a-a164-40fd954645ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3b4e08-aa4f-408a-a164-40fd954645ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d00a4-6f33-454b-8cb5-dc7787ea2cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:35 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Volume f725c65f-265e-47a2-beb0-edff74f461e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f725c65f-265e-47a2-beb0-edff74f461e7', 'volume_size': 1} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078518382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f725c65f-265e-47a2-beb0-edff74f461e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125eabb716144e2588f1ddcfa34d6591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:35Z,use_quota=True,user_id='0ec904c239d44d9db15157254c1aca8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Creating volume f725c65f-265e-47a2-beb0-edff74f461e7 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:35 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 1073741824 Sep 17 15:17:35 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:35 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 1073741824" returned: 0 in 0.445s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:35 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 Sep 17 15:17:35 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:36 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7" returned: 0 in 0.306s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.044s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114d00a4-6f33-454b-8cb5-dc7787ea2cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f725c65f-265e-47a2-beb0-edff74f461e7', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e13489-8f9e-449b-9e6d-626b45182222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 4c0815e9-a402-4da4-98a7-4c5f6273f550 of volume 32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:36 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Volume volume-f725c65f-265e-47a2-beb0-edff74f461e7 (f725c65f-265e-47a2-beb0-edff74f461e7): created successfully Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45e13489-8f9e-449b-9e6d-626b45182222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Flow 'volume_create_manager' (7b441edb-8bfc-49bd-932c-2fc4b285a076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2c7584-0411-4643-8683-0a783576c3e5]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-44e98dc2-ef67-41f5-8f1a-3563d4d5ccce tempest-ProjectReaderTests-1150968610 None] Created volume successfully. Sep 17 15:17:36 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 Sep 17 15:17:36 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 1G Sep 17 15:17:36 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:36 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 1G" returned: 0 in 0.436s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:36 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:36 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 Sep 17 15:17:36 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:37 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:37 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 is being set with open permissions: ugo+rw Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:37 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 Sep 17 15:17:37 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Acquiring lock "cinder-f725c65f-265e-47a2-beb0-edff74f461e7-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "cinder-f725c65f-265e-47a2-beb0-edff74f461e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Acquiring lock "cinder-quobyte-f725c65f-265e-47a2-beb0-edff74f461e7" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "cinder-quobyte-f725c65f-265e-47a2-beb0-edff74f461e7" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3287a6e-f51b-4bb8-a17b-ab21acfa90ee]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:37 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550" returned: 0 in 0.407s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:37 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:37 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info Sep 17 15:17:37 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:37 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 Sep 17 15:17:37 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:38 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info is being set with open permissions: ugo+rw Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:38 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info Sep 17 15:17:38 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:38 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7" returned: 0 in 0.465s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:38 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7 Sep 17 15:17:38 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:38 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.info" returned: 0 in 0.297s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.348s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2d26a7b5-b385-4704-841b-c00f0f76df0c tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:17:38 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f725c65f-265e-47a2-beb0-edff74f461e7" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "cinder-quobyte-f725c65f-265e-47a2-beb0-edff74f461e7" released by "delete_volume" :: held 0.855s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Created reservations ['9adf7f91-0e36-43dc-a8fb-63f960c3ae9a', '871c58d0-8717-4158-b59a-cd94162246f0', '9dc90292-d977-4da6-83fb-321c7869e678', '4ff0c46c-b86c-4736-aed0-e77c2c797fc1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:38 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:38 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:38 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:38 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Deleted volume successfully. Sep 17 15:17:38 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f3760dc4-8278-4d6b-8b29-0ed87207f89f tempest-ProjectReaderTests-1150968610 None] Lock "cinder-f725c65f-265e-47a2-beb0-edff74f461e7-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-4c0815e9-a402-4da4-98a7-4c5f6273f550-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-4c0815e9-a402-4da4-98a7-4c5f6273f550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-4c0815e9-a402-4da4-98a7-4c5f6273f550" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-4c0815e9-a402-4da4-98a7-4c5f6273f550" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 4c0815e9-a402-4da4-98a7-4c5f6273f550 of volume 32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bbdc5c-f9a7-4ef6-8c98-b58dda9e045b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Flow 'volume_create_manager' (d240f83b-3fde-4d5f-aa5d-b88d5cfe56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8602f0-32f8-48dc-87ee-7f55fef8f821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de8602f0-32f8-48dc-87ee-7f55fef8f821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540045659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65da20c-fbc0-40ad-b6fb-b07dc5385f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125eabb716144e2588f1ddcfa34d6591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:39Z,use_quota=True,user_id='0ec904c239d44d9db15157254c1aca8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 Sep 17 15:17:39 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8f7fa0-7fd7-43b5-a90e-1ed3b7cebf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8f7fa0-7fd7-43b5-a90e-1ed3b7cebf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c82e8d-cbd6-430f-bbaa-1fa22189e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90c82e8d-cbd6-430f-bbaa-1fa22189e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65da20c-fbc0-40ad-b6fb-b07dc5385f3c', 'volume_name': 'volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2501ae-147f-47e4-bdf4-7c351c8aed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2501ae-147f-47e4-bdf4-7c351c8aed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29892c50-140c-4a37-a202-7b52059bd2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Volume c65da20c-fbc0-40ad-b6fb-b07dc5385f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c', 'volume_size': 1} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-540045659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65da20c-fbc0-40ad-b6fb-b07dc5385f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='125eabb716144e2588f1ddcfa34d6591',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:39Z,use_quota=True,user_id='0ec904c239d44d9db15157254c1aca8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Creating volume c65da20c-fbc0-40ad-b6fb-b07dc5385f3c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:39 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:39 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c 1073741824 Sep 17 15:17:39 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:39 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550" returned: 0 in 0.438s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[27858ed1-817b-41ae-a178-75cce9d722c8]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 Sep 17 15:17:40 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c 1073741824" returned: 0 in 0.632s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c Sep 17 15:17:40 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00" returned: 0 in 0.531s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 Sep 17 15:17:40 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:40 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" returned: 0 in 0.333s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29892c50-140c-4a37-a202-7b52059bd2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7ce78f-e3e2-475a-b706-5e7d16f1782a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:40 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Volume volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c (c65da20c-fbc0-40ad-b6fb-b07dc5385f3c): created successfully Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7ce78f-e3e2-475a-b706-5e7d16f1782a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Flow 'volume_create_manager' (d240f83b-3fde-4d5f-aa5d-b88d5cfe56db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:40 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-122beb85-e63e-4bba-b0f2-3298279f082f tempest-ProjectReaderTests-1150968610 None] Created volume successfully. Sep 17 15:17:40 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:40 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550 Sep 17 15:17:40 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:41 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00.4c0815e9-a402-4da4-98a7-4c5f6273f550" returned: 0 in 0.268s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-4c0815e9-a402-4da4-98a7-4c5f6273f550" released by "_delete_snapshot" :: held 1.787s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" released by "delete_snapshot" :: held 1.837s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Created reservations ['d256241b-37b7-4ba6-bb6b-1c95e976a7d7', 'd24f26d9-113c-4e90-9cda-3c66ac205f06', 'bb5c0775-81e3-4908-b76a-f927822eef95', '5c19a2c5-2050-48ff-8c3f-91531a836ee1'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-469750d8-20c6-4d5e-816c-4056f1e2f4e6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-4c0815e9-a402-4da4-98a7-4c5f6273f550-delete_snapshot" released by "delete_snapshot" :: held 2.019s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-32299b4c-5742-46ca-8eec-9cbb65ff7f00-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "cinder-32299b4c-5742-46ca-8eec-9cbb65ff7f00-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Acquiring lock "cinder-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "cinder-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" acquired by "delete_volume" :: waited 0.042s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c9b07-e8f3-417d-b8b0-a048984f89a9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Acquiring lock "cinder-quobyte-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "cinder-quobyte-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" acquired by "delete_volume" :: waited 0.035s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccab381-a766-4adc-b75e-587b42f71c01]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:41 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 Sep 17 15:17:41 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c Sep 17 15:17:42 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00" returned: 0 in 0.480s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:42 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00 Sep 17 15:17:42 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" returned: 0 in 0.485s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:42 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c Sep 17 15:17:42 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-32299b4c-5742-46ca-8eec-9cbb65ff7f00" returned: 0 in 0.257s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-32299b4c-5742-46ca-8eec-9cbb65ff7f00" released by "delete_volume" :: held 0.850s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Created reservations ['194d679e-b043-413c-9d5d-7b9c4762c8f9', '6124c6ca-7e47-4f3a-9874-b47139601468', '8382071f-8c57-4bc3-8698-1feb82cffd07', '84de9a77-ac01-49fc-90ab-818c1b8b37fd'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:42 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "cinder-quobyte-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c" released by "delete_volume" :: held 0.830s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:42 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:42 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Created reservations ['84b747d4-bf24-4159-91c7-79cd2752b803', 'b0a52a1e-654d-4829-9293-8f64b369c0ee', '6fcbab72-94f0-4d1a-87d1-76187be45707', '6a8e259c-a886-4d08-9278-0af4491ef38c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Flow 'volume_create_manager' (211ca27c-d988-47bf-a469-baa464368a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a5ef92-258f-49ba-bcc6-76187e9be2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a5ef92-258f-49ba-bcc6-76187e9be2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-862991414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f578aaa8-be56-472f-be12-36a429d4a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf5ff6c24d45ad9b297be1d72a3bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:43Z,use_quota=True,user_id='20c1dab4e83f43cba57854873b5bd16c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e292d5-4708-40da-8337-a815c3651f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8e292d5-4708-40da-8337-a815c3651f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ae94b-4587-4292-bfda-90b016040529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e0ae94b-4587-4292-bfda-90b016040529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f578aaa8-be56-472f-be12-36a429d4a11e', 'volume_name': 'volume-f578aaa8-be56-472f-be12-36a429d4a11e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4b42ff-04ea-4a4c-b821-b989698d1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4b42ff-04ea-4a4c-b821-b989698d1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202098ba-54db-4ded-84c9-6fdcc19e3ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:42 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Volume f578aaa8-be56-472f-be12-36a429d4a11e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f578aaa8-be56-472f-be12-36a429d4a11e', 'volume_size': 1} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-862991414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f578aaa8-be56-472f-be12-36a429d4a11e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf5ff6c24d45ad9b297be1d72a3bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:43Z,use_quota=True,user_id='20c1dab4e83f43cba57854873b5bd16c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Creating volume f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:42 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:42 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e 1073741824 Sep 17 15:17:42 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:43 devstack sudo[103629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:43 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:43 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f58a8293-23cc-4461-9ea6-bb913941656a tempest-ProjectMemberTests-150498844 None] Lock "cinder-32299b4c-5742-46ca-8eec-9cbb65ff7f00-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:43 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (2217a55b-3225-4977-8f19-8c2682f26c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614c0e5-c427-423d-8047-3ea192634be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.363s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Deleted volume successfully. Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0614c0e5-c427-423d-8047-3ea192634be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469121305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:43Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d943e65-5e42-4092-9f0d-84c65c22a5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d943e65-5e42-4092-9f0d-84c65c22a5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b4b12-29c2-45d8-a5ff-ea36a6525896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597b4b12-29c2-45d8-a5ff-ea36a6525896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3', 'volume_name': 'volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b27288-3b2a-47bf-97f5-60dac1ee223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b27288-3b2a-47bf-97f5-60dac1ee223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7131ccef-3967-4872-9600-321558314fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Volume fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3', 'volume_size': 1} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-3d65ac86-662d-41df-aa19-552c74cafbf9 tempest-ProjectReaderTests-1150968610 None] Lock "cinder-c65da20c-fbc0-40ad-b6fb-b07dc5385f3c-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:43 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e 1073741824" returned: 0 in 0.546s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:43 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:17:43 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:43 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.333s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1469121305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:43Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Creating volume fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:43 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 1073741824 Sep 17 15:17:43 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (202098ba-54db-4ded-84c9-6fdcc19e3ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f578aaa8-be56-472f-be12-36a429d4a11e', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7adcf78-af4d-48de-8c99-27c904a2a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Volume volume-f578aaa8-be56-472f-be12-36a429d4a11e (f578aaa8-be56-472f-be12-36a429d4a11e): created successfully Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7adcf78-af4d-48de-8c99-27c904a2a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:43 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Flow 'volume_create_manager' (211ca27c-d988-47bf-a469-baa464368a77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0b00a0f9-b15e-4c97-b044-27ee53bf54f1 tempest-SnapshotDependencyTests-933695290 None] Created volume successfully. Sep 17 15:17:44 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 1073741824" returned: 0 in 0.464s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:44 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 Sep 17 15:17:44 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:44 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7131ccef-3967-4872-9600-321558314fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b9ff3f-172a-4aaf-a59f-1c25e055d808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:44 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Volume volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 (fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3): created successfully Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b9ff3f-172a-4aaf-a59f-1c25e055d808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:44 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (2217a55b-3225-4977-8f19-8c2682f26c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:44 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-48978488-b515-45ad-8599-5ee595acb795 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Creating offline snapshot cc45c972-dfcc-4356-95da-aadeb06baabe of volume f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ad5c7-54cd-40e1-8dd0-5eb5114e8a84]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:45 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:17:45 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:45 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.442s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:45 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe 1G Sep 17 15:17:45 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe 1G" returned: 0 in 0.403s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f578aaa8-be56-472f-be12-36a429d4a11e -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f578aaa8-be56-472f-be12-36a429d4a11e -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:46 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f578aaa8-be56-472f-be12-36a429d4a11e -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe is being set with open permissions: ugo+rw Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:46 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.238s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[103668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info Sep 17 15:17:46 devstack sudo[103668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:46 devstack sudo[103668]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info" returned: 0 in 0.261s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:46 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info is being set with open permissions: ugo+rw Sep 17 15:17:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:46 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info Sep 17 15:17:46 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:47 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.info" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.546s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 8f386024-2322-4c87-bdb5-51d21dad4c26 of volume fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:47 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a42910b1-dc5d-41d2-98c1-c348e09d871b tempest-SnapshotDependencyTests-933695290 None] Create snapshot completed successfully Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de277fe-4327-4819-b527-2fcd59efef8f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:47 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 Sep 17 15:17:47 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:47 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:47 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 1G Sep 17 15:17:47 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Flow 'volume_create_manager' (09f1f63c-a21e-4efb-a35c-273b53f0cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4913d9-9c1d-4bca-b7fd-d4c57bddbb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb4913d9-9c1d-4bca-b7fd-d4c57bddbb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0398828b-882f-42d4-8b2b-4d7e7aa46cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbbf5ff6c24d45ad9b297be1d72a3bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc45c972-dfcc-4356-95da-aadeb06baabe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:48Z,use_quota=True,user_id='20c1dab4e83f43cba57854873b5bd16c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6435cd83-d324-44c1-ab5f-518610bc99eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6435cd83-d324-44c1-ab5f-518610bc99eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daf3046-eb23-47e1-a015-7e2fd2ba648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8daf3046-eb23-47e1-a015-7e2fd2ba648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0398828b-882f-42d4-8b2b-4d7e7aa46cc2', 'volume_name': 'volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2', 'volume_size': 1, 'snapshot_id': 'cc45c972-dfcc-4356-95da-aadeb06baabe'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbc1aa9-2405-4ab2-b38f-0fb398820e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cbc1aa9-2405-4ab2-b38f-0fb398820e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86dfb47-b416-4fe4-a301-051c78dfbc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:47 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Volume 0398828b-882f-42d4-8b2b-4d7e7aa46cc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2', 'volume_size': 1, 'snapshot_id': 'cc45c972-dfcc-4356-95da-aadeb06baabe'} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:47 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 1G" returned: 0 in 0.435s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 Sep 17 15:17:48 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:48 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26" returned: 0 in 0.283s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 is being set with open permissions: ugo+rw Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 Sep 17 15:17:48 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:48 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info Sep 17 15:17:48 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:48 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info is being set with open permissions: ugo+rw Sep 17 15:17:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:48 devstack sudo[103731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info Sep 17 15:17:48 devstack sudo[103731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[103731]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.info" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.092s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" by "_create_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Creating volume 0398828b-882f-42d4-8b2b-4d7e7aa46cc2 from snapshot cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" by "_copy_volume_from_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:49 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ef76ac57-a28d-42c2-9da3-95bd9c9458bf tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] snapshot: cc45c972-dfcc-4356-95da-aadeb06baabe, volume: 0398828b-882f-42d4-8b2b-4d7e7aa46cc2, {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b68b33-3346-4ae9-87d0-a4e863cfe77e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:49 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f578aaa8-be56-472f-be12-36a429d4a11e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f2629-419b-40fb-b8ef-4d9d2f4c2083]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[103739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:17:49 devstack sudo[103739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-8f386024-2322-4c87-bdb5-51d21dad4c26-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-8f386024-2322-4c87-bdb5-51d21dad4c26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-8f386024-2322-4c87-bdb5-51d21dad4c26" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-8f386024-2322-4c87-bdb5-51d21dad4c26" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 8f386024-2322-4c87-bdb5-51d21dad4c26 of volume fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:49 devstack sudo[103739]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.390s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] will copy from snapshot at /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Creating direct copy from snapshot {{(pid=85963) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG cinder.utils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Path /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 not found in is_blk_device check {{(pid=85963) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea37d37-d3e2-462f-a0d9-74a6349ae7a9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:49 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 Sep 17 15:17:49 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:50 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 Sep 17 15:17:50 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:50 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26" returned: 0 in 0.375s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4070a-e422-4afb-b9e5-0d98e93ae796]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:50 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 Sep 17 15:17:50 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:50 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" returned: 0 in 0.607s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:50 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 Sep 17 15:17:50 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:51 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26" returned: 0 in 0.533s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:51 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26 Sep 17 15:17:51 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:51 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3.8f386024-2322-4c87-bdb5-51d21dad4c26" returned: 0 in 0.464s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-8f386024-2322-4c87-bdb5-51d21dad4c26" released by "_delete_snapshot" :: held 2.125s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" released by "delete_snapshot" :: held 2.175s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Created reservations ['0a74e9d5-2d18-47f1-8a64-c2f945e7fd76', '6ee64aed-2fc0-4f96-9873-ce3c2e7ef719', '47e6f40a-2bed-4902-90cc-1eeab862cc86', 'a93f8a3c-c682-4139-9b0b-4afd682f67e2'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:17:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2aaaf158-8233-43a0-83e5-90b0fd7968c6 tempest-ProjectMemberTests-150498844 None] Lock "cinder-8f386024-2322-4c87-bdb5-51d21dad4c26-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "cinder-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" acquired by "delete_volume" :: waited 0.033s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76c413-dcdc-4269-b443-1017805630a2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:53 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 Sep 17 15:17:53 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:53 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" returned: 0 in 0.547s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:53 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3 Sep 17 15:17:53 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:54 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" returned: 0 in 0.367s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3" released by "delete_volume" :: held 1.052s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Created reservations ['9aba6da9-fb38-48b1-bd0c-f7f7eb0e788d', '9dbf9a94-cf4b-4aeb-a8ad-4fd42c4ab8e8', 'e5b36556-bd25-46c6-89be-ce66666c6fb2', 'a36fb781-df98-4913-9ad2-21c05e612b53'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:54 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:54 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:54 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.451s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:54 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:17:55 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-77436a6d-9a10-4744-8004-3a8ee3c08687 tempest-ProjectMemberTests-150498844 None] Lock "cinder-fbb0f056-9f75-46cf-b3fd-1d7e8a3b70c3-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (2bf54f48-9d37-4542-91d3-30cb7c4dc56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b7ef94-dee4-4462-b65b-dca50b5e2b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b7ef94-dee4-4462-b65b-dca50b5e2b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97830149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba2c2c8-0d55-4139-a9e4-707867e9c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:56Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4197d45d-dbf0-44b9-a53e-dacc817755de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4197d45d-dbf0-44b9-a53e-dacc817755de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b372f299-56bb-4cbe-871a-e562d6c22c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b372f299-56bb-4cbe-871a-e562d6c22c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba2c2c8-0d55-4139-a9e4-707867e9c671', 'volume_name': 'volume-dba2c2c8-0d55-4139-a9e4-707867e9c671', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf29cc3-30bd-40ab-9078-a7572113f7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf29cc3-30bd-40ab-9078-a7572113f7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d2e195-2e05-4d56-98a3-94e9143ac784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Volume dba2c2c8-0d55-4139-a9e4-707867e9c671: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba2c2c8-0d55-4139-a9e4-707867e9c671', 'volume_size': 1} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:56 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" returned: 0 in 6.514s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.image.image_utils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Image conversion details: src /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 {{(pid=85963) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 17 15:17:56 devstack cinder-volume[85963]: INFO cinder.image.image_utils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Converted 1024.00 MB image at 157.17 MB/s Sep 17 15:17:56 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 is being set with open permissions: ugo+rw Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:56 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 Sep 17 15:17:56 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:56 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" returned: 0 in 0.232s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" released by "_copy_volume_from_snapshot" :: held 7.566s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" released by "_create_volume_from_snapshot" :: held 7.631s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.656s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97830149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba2c2c8-0d55-4139-a9e4-707867e9c671,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:17:56Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Creating volume dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:17:56 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:56 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 1073741824 Sep 17 15:17:56 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86dfb47-b416-4fe4-a301-051c78dfbc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2', 'volume_size': 1, 'snapshot_id': 'cc45c972-dfcc-4356-95da-aadeb06baabe'}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a896003f-62dd-4dc8-9f4c-36cc29710e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:56 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Volume volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 (0398828b-882f-42d4-8b2b-4d7e7aa46cc2): created successfully Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a896003f-62dd-4dc8-9f4c-36cc29710e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Flow 'volume_create_manager' (09f1f63c-a21e-4efb-a35c-273b53f0cc10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:56 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2b733c5f-e46f-4d3e-bb4c-3f29fac995bf tempest-SnapshotDependencyTests-933695290 None] Created volume successfully. Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:57 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:17:57 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:57 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 1073741824" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:57 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 Sep 17 15:17:57 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:57 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:17:57 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10d2e195-2e05-4d56-98a3-94e9143ac784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba2c2c8-0d55-4139-a9e4-707867e9c671', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b0e0b-2dbd-47bb-9ce1-fb53d9c215bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:17:57 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Volume volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 (dba2c2c8-0d55-4139-a9e4-707867e9c671): created successfully Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (357b0e0b-2dbd-47bb-9ce1-fb53d9c215bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (2bf54f48-9d37-4542-91d3-30cb7c4dc56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:17:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2c6c179e-76ed-4678-805f-6bfa7d1a5d04 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-cc45c972-dfcc-4356-95da-aadeb06baabe-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-cc45c972-dfcc-4356-95da-aadeb06baabe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Deleting offline snapshot cc45c972-dfcc-4356-95da-aadeb06baabe of volume f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] snapshot_file for this snap is: volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f7ab8-c622-4998-9098-3a6fd45d34c6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:57 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:57 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:58 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f578aaa8-be56-472f-be12-36a429d4a11e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[652c1203-78db-4085-8377-e9ae74a9339a]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:58 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:17:58 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 7d1d4321-3fbc-4908-a396-10b424ebb0f6 of volume dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[054e37e6-2726-434b-a24f-bc019b833dbc]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:58 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 Sep 17 15:17:58 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:58 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.538s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:58 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:58 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:58 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671" returned: 0 in 0.393s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:58 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 1G Sep 17 15:17:58 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:59 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.391s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:59 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe Sep 17 15:17:59 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:59 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 1G" returned: 0 in 0.433s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:59 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 Sep 17 15:17:59 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:59 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e.cc45c972-dfcc-4356-95da-aadeb06baabe" returned: 0 in 0.280s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-cc45c972-dfcc-4356-95da-aadeb06baabe" released by "_delete_snapshot" :: held 1.677s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" released by "delete_snapshot" :: held 1.705s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Created reservations ['9af025b6-849c-443d-b7ae-cef696226ae5', 'a64d776f-ad68-4231-be1c-ce2298823189', '6e1a992f-1fed-4fef-8a5e-d24175df8379', '558f06f3-a618-4248-ad00-8ec6551a2aae'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:17:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Delete snapshot completed successfully. Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f9e9147a-54f2-4a43-b493-eb3e7a4e0c72 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-cc45c972-dfcc-4356-95da-aadeb06baabe-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:17:59 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:59 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 is being set with open permissions: ugo+rw Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:59 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 Sep 17 15:17:59 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:59 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-f578aaa8-be56-472f-be12-36a429d4a11e-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:59 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info Sep 17 15:17:59 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-f578aaa8-be56-472f-be12-36a429d4a11e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d8e9a-a77a-46c8-a61e-77f8f40987e4]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:17:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:00 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:18:00 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:00 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info" returned: 0 in 0.276s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:00 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info is being set with open permissions: ugo+rw Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:00 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info Sep 17 15:18:00 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:00 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.info" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:00 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.995s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.401s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:00 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e Sep 17 15:18:00 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-eac007ba-1c73-4a02-9657-7cc584aca189 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:18:00 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f578aaa8-be56-472f-be12-36a429d4a11e" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-f578aaa8-be56-472f-be12-36a429d4a11e" released by "delete_volume" :: held 0.713s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Created reservations ['c76a609e-3539-4821-aef0-cbd71a3c080d', 'd6427f57-da53-425d-8227-af3e3159f640', '12e65dc8-aa91-4d55-a74a-0d00a0bc0901', '8a803cb0-5a1e-4384-8448-08ef9854b34a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:00 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:00 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:00 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Deleted volume successfully. Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-0398828b-882f-42d4-8b2b-4d7e7aa46cc2-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-45ef1371-9b2d-4f97-9b97-b8ecb8510aa7 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-f578aaa8-be56-472f-be12-36a429d4a11e-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:00 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-0398828b-882f-42d4-8b2b-4d7e7aa46cc2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c37474-d9c7-47cf-bc27-4544fda42d01]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:01 devstack sudo[103863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 Sep 17 15:18:01 devstack sudo[103863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:01 devstack sudo[103863]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:01 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2 Sep 17 15:18:01 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-7d1d4321-3fbc-4908-a396-10b424ebb0f6-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-7d1d4321-3fbc-4908-a396-10b424ebb0f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-7d1d4321-3fbc-4908-a396-10b424ebb0f6" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-7d1d4321-3fbc-4908-a396-10b424ebb0f6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 7d1d4321-3fbc-4908-a396-10b424ebb0f6 of volume dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d108cf5f-1713-4da2-b473-a076d90bef2b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:01 devstack sudo[103872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 Sep 17 15:18:01 devstack sudo[103872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:01 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-quobyte-0398828b-882f-42d4-8b2b-4d7e7aa46cc2" released by "delete_volume" :: held 0.696s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Created reservations ['6fd75568-563e-4f2b-8904-e7c500112f03', 'ef67c5c3-2726-435c-be77-08d6e7bf0e0b', 'd1a25730-e7a0-451f-abc0-79cc2400d2de', '913ad0b1-e64f-48ca-82f9-2410b03b659b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:01 devstack sudo[103876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:01 devstack sudo[103876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:01 devstack sudo[103872]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dba2c2c8-0d55-4139-a9e4-707867e9c671(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672d67b-bd04-4cdd-9ff4-2849a8386e63]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:02 devstack sudo[103881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 Sep 17 15:18:02 devstack sudo[103881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:02 devstack sudo[103876]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.284s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Deleted volume successfully. Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-f07e285b-0a8a-43f6-b31d-4ad8b752a154 tempest-SnapshotDependencyTests-933695290 None] Lock "cinder-0398828b-882f-42d4-8b2b-4d7e7aa46cc2-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:02 devstack sudo[103881]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:02 devstack sudo[103887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 Sep 17 15:18:02 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:02 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:02 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6 Sep 17 15:18:02 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:03 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671.7d1d4321-3fbc-4908-a396-10b424ebb0f6" returned: 0 in 0.304s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-7d1d4321-3fbc-4908-a396-10b424ebb0f6" released by "_delete_snapshot" :: held 1.536s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" released by "delete_snapshot" :: held 1.560s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Created reservations ['109b64a3-63ef-47ea-8bb6-21be31977d8a', '8cce98b8-7aad-491a-b9d4-97ef5899e382', 'abbd8240-1880-4e23-b8a9-ae46f78a4f57', '719bd865-2a69-45ed-8df6-eaabb1c198f9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:03 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ca91f3b0-86c1-4579-a404-53f1b2d3be81 tempest-ProjectMemberTests-150498844 None] Lock "cinder-7d1d4321-3fbc-4908-a396-10b424ebb0f6-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-dba2c2c8-0d55-4139-a9e4-707867e9c671-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "cinder-dba2c2c8-0d55-4139-a9e4-707867e9c671-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[d010653d-57e2-4e1b-911c-f2e946c2a330]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:03 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 Sep 17 15:18:03 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:04 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671" returned: 0 in 0.386s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:04 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671 Sep 17 15:18:04 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:04 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-dba2c2c8-0d55-4139-a9e4-707867e9c671" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-dba2c2c8-0d55-4139-a9e4-707867e9c671" released by "delete_volume" :: held 0.710s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Created reservations ['cc7d7408-e6c2-4591-a424-8267b3b0399c', 'ce2c4129-1b8d-4cce-89a8-74cb0416c15d', '81129adf-f1e0-4955-8461-41999864a5bc', 'ac7d9a0c-a84a-4c7f-8948-23baea678c11'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:04 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:04 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:04 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.274s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:18:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-fe7d1b6d-a68d-4171-ae86-3b77492d3659 tempest-ProjectMemberTests-150498844 None] Lock "cinder-dba2c2c8-0d55-4139-a9e4-707867e9c671-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (908d5e81-93d4-4530-98a6-588b0f2da21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86027f9-70f1-424d-a404-b98563868e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86027f9-70f1-424d-a404-b98563868e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417806604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:05Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c747b1d-10f8-48f8-b5c4-a2c681b451ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c747b1d-10f8-48f8-b5c4-a2c681b451ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5de6124-c973-4c7d-86f2-e79f089659f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5de6124-c973-4c7d-86f2-e79f089659f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3', 'volume_name': 'volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb1665-0581-46cf-a489-096f988b4e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cbb1665-0581-46cf-a489-096f988b4e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e22c0b1-d647-4e53-8800-32de2fc4a57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:05 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Volume 1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3', 'volume_size': 1} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1417806604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:05Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Creating volume 1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:05 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:05 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 1073741824 Sep 17 15:18:05 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:05 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 1073741824" returned: 0 in 0.505s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:05 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 Sep 17 15:18:05 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:06 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" returned: 0 in 0.272s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e22c0b1-d647-4e53-8800-32de2fc4a57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff229fce-7cba-4eef-a34e-d1c5fc880c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Volume volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 (1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3): created successfully Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff229fce-7cba-4eef-a34e-d1c5fc880c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (908d5e81-93d4-4530-98a6-588b0f2da21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-fa56e97b-5763-4c8c-8e18-7d9d2736cf17 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 293a4a75-430e-4695-bcb4-59cfeb8724bf of volume 1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a5f46-2c9a-4a30-9657-b9c20f66c34b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:07 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 Sep 17 15:18:07 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:07 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:07 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf 1G Sep 17 15:18:07 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:08 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf 1G" returned: 0 in 0.428s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:08 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf Sep 17 15:18:08 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:08 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf" returned: 0 in 0.323s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:08 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf is being set with open permissions: ugo+rw Sep 17 15:18:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:08 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf Sep 17 15:18:08 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:08 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf" returned: 0 in 0.266s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:09 devstack sudo[103941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info Sep 17 15:18:09 devstack sudo[103941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:09 devstack sudo[103941]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info" returned: 0 in 0.255s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info is being set with open permissions: ugo+rw Sep 17 15:18:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:09 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info Sep 17 15:18:09 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:09 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.info" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3cde0cd0-a402-4482-8f43-f8e1b22bf768 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-293a4a75-430e-4695-bcb4-59cfeb8724bf-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-293a4a75-430e-4695-bcb4-59cfeb8724bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-293a4a75-430e-4695-bcb4-59cfeb8724bf" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-293a4a75-430e-4695-bcb4-59cfeb8724bf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 293a4a75-430e-4695-bcb4-59cfeb8724bf of volume 1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b83512d-90ac-4503-9a16-f51161b16839]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:10 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf Sep 17 15:18:10 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:11 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e6cb9b-f99a-4f35-a617-d8873aa30d5b]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:11 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 Sep 17 15:18:11 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:11 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" returned: 0 in 0.400s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:11 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf Sep 17 15:18:11 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:12 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf" returned: 0 in 0.383s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:12 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf Sep 17 15:18:12 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:12 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3.293a4a75-430e-4695-bcb4-59cfeb8724bf" returned: 0 in 0.270s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-293a4a75-430e-4695-bcb4-59cfeb8724bf" released by "_delete_snapshot" :: held 1.561s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" released by "delete_snapshot" :: held 1.584s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Created reservations ['c485e122-2a37-40c5-8015-d927158cb29e', '4c9389cb-de4c-4ef2-8a39-9f272b9b5396', 'df41bf56-b655-4139-9b46-e7467c80304b', '0e0ee2d4-866b-4e42-9595-f9be7ac49309'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:12 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1c5a596f-4b23-4c40-9354-f2da5c6f0234 tempest-ProjectMemberTests-150498844 None] Lock "cinder-293a4a75-430e-4695-bcb4-59cfeb8724bf-delete_snapshot" released by "delete_snapshot" :: held 1.732s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "cinder-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[80acba4e-404a-4438-9470-cb3bb3201f40]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:13 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 Sep 17 15:18:13 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:13 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:13 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3 Sep 17 15:18:13 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:13 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3" released by "delete_volume" :: held 0.674s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Created reservations ['2a029bb4-db6f-40ee-8c31-9d696777ef4e', '3bae9750-fb5a-4161-92f8-f000fe615764', '82b9cced-583e-4e21-a7e0-4392771a5ede', 'a018f4a5-0451-4711-845d-69b1da86312c'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:13 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:13 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:13 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.249s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:13 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-132d7a97-6552-466d-ac3f-1954938dc61d tempest-ProjectMemberTests-150498844 None] Lock "cinder-1cf7e0d6-01a7-4e61-9a6a-680fc845ffd3-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (359240b8-2f53-4454-8535-933f15858c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8d67b6-9d31-458f-9df9-344683f95c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8d67b6-9d31-458f-9df9-344683f95c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262639696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d481aaa1-6a56-420f-b1ac-8611c29eb5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:14Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66bf62d-7d0a-4b14-9004-5b1eb750eb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c66bf62d-7d0a-4b14-9004-5b1eb750eb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec48560-d28e-42ca-91e7-91cdbf73f6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec48560-d28e-42ca-91e7-91cdbf73f6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd481aaa1-6a56-420f-b1ac-8611c29eb5fd', 'volume_name': 'volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc5f15-632a-4ae5-804b-cf0fe335eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fc5f15-632a-4ae5-804b-cf0fe335eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4347e8e6-ec9e-4f15-9a04-5ae312e5e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:14 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Volume d481aaa1-6a56-420f-b1ac-8611c29eb5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd', 'volume_size': 1} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1262639696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d481aaa1-6a56-420f-b1ac-8611c29eb5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:14Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Creating volume d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:14 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:14 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd 1073741824 Sep 17 15:18:14 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:14 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:14 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd 1073741824" returned: 0 in 0.414s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:15 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd Sep 17 15:18:15 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:15 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4347e8e6-ec9e-4f15-9a04-5ae312e5e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779fc1bc-3a71-4272-9256-51c014bc7828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:15 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Volume volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd (d481aaa1-6a56-420f-b1ac-8611c29eb5fd): created successfully Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779fc1bc-3a71-4272-9256-51c014bc7828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (359240b8-2f53-4454-8535-933f15858c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:15 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-31727535-6c44-4154-a203-e75d41548e77 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 49bb6212-b063-4460-8f38-7975df65444c of volume d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa2867d-bc2c-4259-b4bb-7522a5f3a404]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:15 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:15 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd Sep 17 15:18:15 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:16 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" returned: 0 in 0.361s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:16 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c 1G Sep 17 15:18:16 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:16 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c 1G" returned: 0 in 0.388s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:16 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c Sep 17 15:18:16 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:16 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c" returned: 0 in 0.289s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:16 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c is being set with open permissions: ugo+rw Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:16 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c Sep 17 15:18:16 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:16 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c" returned: 0 in 0.259s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:DELETE=14,cinder:SELECT=125,cinder:INSERT=45,cinder:UPDATE=160 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:16 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=123,cinder:INSERT=39,cinder:UPDATE=158,cinder:DELETE=13 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:17 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info Sep 17 15:18:17 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:17 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:17 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info is being set with open permissions: ugo+rw Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:17 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info Sep 17 15:18:17 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:17 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.info" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.878s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:17 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-cb2f6a14-ef86-4182-9406-729eb0a15c51 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-49bb6212-b063-4460-8f38-7975df65444c-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-49bb6212-b063-4460-8f38-7975df65444c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-49bb6212-b063-4460-8f38-7975df65444c" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-49bb6212-b063-4460-8f38-7975df65444c" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 49bb6212-b063-4460-8f38-7975df65444c of volume d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b636e0-e46c-412c-ab01-e26006bbb43e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:17 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:17 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c Sep 17 15:18:17 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:18 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9db9c8-355b-42bc-944c-f659d1f5174d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:18 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd Sep 17 15:18:18 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:18 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:18 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c Sep 17 15:18:18 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:18 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c" returned: 0 in 0.318s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:18 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:19 devstack sudo[104028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c Sep 17 15:18:19 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:19 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd.49bb6212-b063-4460-8f38-7975df65444c" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-49bb6212-b063-4460-8f38-7975df65444c" released by "_delete_snapshot" :: held 1.438s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" released by "delete_snapshot" :: held 1.457s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Created reservations ['88187a07-269d-43cc-95e6-ac44c13b0bfd', '3152f9d0-e6b7-4a3c-9256-2f909a234878', '5e2c1c78-0924-4128-8838-c436676583f9', 'b665739b-1b27-4e50-82a7-7215de026725'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:19 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-2b30ac34-bd2d-46f7-8ffb-12d9abb4a5d1 tempest-ProjectMemberTests-150498844 None] Lock "cinder-49bb6212-b063-4460-8f38-7975df65444c-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-d481aaa1-6a56-420f-b1ac-8611c29eb5fd-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "cinder-d481aaa1-6a56-420f-b1ac-8611c29eb5fd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:19 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[29695bcb-8e46-4501-bd7b-7e61c53e84d0]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:20 devstack sudo[104031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd Sep 17 15:18:20 devstack sudo[104031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:20 devstack sudo[104031]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:20 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd Sep 17 15:18:20 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:20 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-d481aaa1-6a56-420f-b1ac-8611c29eb5fd" released by "delete_volume" :: held 0.650s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Created reservations ['085bc6a3-a36e-4154-a3d1-ed5de14af5c3', 'c9badb43-38ca-4863-9bd7-356b93667038', '05968e79-e654-4a4b-9ae8-16741ed6a30b', 'c1c8bd46-9193-472d-b24b-1ac4e436459e'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:20 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:20 devstack sudo[104039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:20 devstack sudo[104039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:21 devstack sudo[104039]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:21 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-961a9afd-961d-4009-b708-63c9ce497c95 tempest-ProjectMemberTests-150498844 None] Lock "cinder-d481aaa1-6a56-420f-b1ac-8611c29eb5fd-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (ce0ab963-9715-4147-8bcd-1952da6afd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b9495d-5b37-4285-b0c1-1e7bbbd05374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b9495d-5b37-4285-b0c1-1e7bbbd05374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398367623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b87aa-a909-4ba2-a8c6-ee949e1994a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:21Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f2bc19-ea60-4835-949a-3e9b71e92b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5f2bc19-ea60-4835-949a-3e9b71e92b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79739eca-0e80-49f6-843e-fdb002a36dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79739eca-0e80-49f6-843e-fdb002a36dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5b87aa-a909-4ba2-a8c6-ee949e1994a9', 'volume_name': 'volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27305dd8-d8db-4b94-adeb-16e707ec6222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27305dd8-d8db-4b94-adeb-16e707ec6222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3452ccaf-7053-4dbc-86cd-72a4afdc9a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:21 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Volume bc5b87aa-a909-4ba2-a8c6-ee949e1994a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9', 'volume_size': 1} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-398367623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5b87aa-a909-4ba2-a8c6-ee949e1994a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:21Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Creating volume bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:21 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:21 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 1073741824 Sep 17 15:18:21 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:21 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:21 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 1073741824" returned: 0 in 0.408s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:22 devstack sudo[104049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 Sep 17 15:18:22 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:22 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3452ccaf-7053-4dbc-86cd-72a4afdc9a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54799f60-5d30-4d7b-8564-e8a396742639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:22 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Volume volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 (bc5b87aa-a909-4ba2-a8c6-ee949e1994a9): created successfully Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54799f60-5d30-4d7b-8564-e8a396742639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (ce0ab963-9715-4147-8bcd-1952da6afd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:22 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e32cd4f2-5195-48bc-bbb5-dba51c080565 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot b50a1aed-64e5-4d27-bf73-f4f751197e30 of volume bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacdb3c1-95e3-4a1d-94eb-8c834d4b7f81]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:22 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:22 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 Sep 17 15:18:22 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:23 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" returned: 0 in 0.362s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:23 devstack sudo[104057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 1G Sep 17 15:18:23 devstack sudo[104057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:23 devstack sudo[104057]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 1G" returned: 0 in 0.384s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:23 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 Sep 17 15:18:23 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:23 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30" returned: 0 in 0.290s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:23 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 is being set with open permissions: ugo+rw Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:23 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 Sep 17 15:18:23 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:23 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:23 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:24 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info Sep 17 15:18:24 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:24 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info" returned: 0 in 0.249s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:24 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info is being set with open permissions: ugo+rw Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:24 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info Sep 17 15:18:24 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:24 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.info" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:24 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-bb861199-c85b-4592-a622-11cad0557e39 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-b50a1aed-64e5-4d27-bf73-f4f751197e30-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-b50a1aed-64e5-4d27-bf73-f4f751197e30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-b50a1aed-64e5-4d27-bf73-f4f751197e30" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-b50a1aed-64e5-4d27-bf73-f4f751197e30" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot b50a1aed-64e5-4d27-bf73-f4f751197e30 of volume bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8761fa18-39e9-4f14-beba-2c0ee02675e2]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:24 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:25 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 Sep 17 15:18:25 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:25 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74d340f-963f-4548-adae-ff6210ce2a54]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:25 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 Sep 17 15:18:25 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:25 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" returned: 0 in 0.345s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:25 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 Sep 17 15:18:25 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:25 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30" returned: 0 in 0.329s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:25 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:25 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30 Sep 17 15:18:25 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:26 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9.b50a1aed-64e5-4d27-bf73-f4f751197e30" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-b50a1aed-64e5-4d27-bf73-f4f751197e30" released by "_delete_snapshot" :: held 1.356s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" released by "delete_snapshot" :: held 1.381s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Created reservations ['766014c5-7dfd-46e8-a320-97fba55f7690', 'd0b0bcb7-dacb-4163-baa6-3aa370698061', 'e0596ce1-fffe-4dd8-8d97-f44c977370ae', 'acd812dd-6c2c-40a2-9658-c042d9b5f79a'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:26 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-0d502b7e-b840-4807-ac4e-f7d0c4df559f tempest-ProjectMemberTests-150498844 None] Lock "cinder-b50a1aed-64e5-4d27-bf73-f4f751197e30-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:26 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "cinder-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b269ebc-928d-4b2e-ad22-24ac1b1a4f25]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:27 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 Sep 17 15:18:27 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:27 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:27 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9 Sep 17 15:18:27 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:27 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9" released by "delete_volume" :: held 0.658s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Created reservations ['c28fbc76-0c0d-408e-836b-1e15022288ea', 'e782b9bc-7ed4-4695-8b82-ad2f2355a239', 'dc1c4e4d-f16e-403f-a969-5a12fa003c91', '79eb9c55-9e70-486c-8d34-6d2b19227a67'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:27 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:27 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:27 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:28 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:28 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a5ab47cf-6979-4ecd-aa9e-3be3f6e47f1b tempest-ProjectMemberTests-150498844 None] Lock "cinder-bc5b87aa-a909-4ba2-a8c6-ee949e1994a9-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (ba281a0b-413f-4aa3-a4b5-b9c38007ee48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b886ef62-b304-46ad-b618-966d01aeed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b886ef62-b304-46ad-b618-966d01aeed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425041374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcee29d-4f98-44a4-ae44-802ae8f97e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:28Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28089656-7f38-45f9-9fb5-08c8b59a989b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28089656-7f38-45f9-9fb5-08c8b59a989b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8144e1ce-76cc-4455-8b51-0eca6c5f987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8144e1ce-76cc-4455-8b51-0eca6c5f987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fcee29d-4f98-44a4-ae44-802ae8f97e6c', 'volume_name': 'volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce64485-1ff7-43b5-814f-c126355257b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce64485-1ff7-43b5-814f-c126355257b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d3437d-22ac-4d11-a6a9-943a72938049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:28 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Volume 5fcee29d-4f98-44a4-ae44-802ae8f97e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c', 'volume_size': 1} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425041374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fcee29d-4f98-44a4-ae44-802ae8f97e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28ac9b1b5dd14e0a9a0960daae889f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:28Z,use_quota=True,user_id='ea80fd9d86b24900a06389cecc5faf05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Creating volume 5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:28 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:28 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:28 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c 1073741824 Sep 17 15:18:28 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:29 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c 1073741824" returned: 0 in 0.415s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:29 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c Sep 17 15:18:29 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:29 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" returned: 0 in 0.238s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63d3437d-22ac-4d11-a6a9-943a72938049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f368a4e-34f2-4e4f-8a72-7b58b5575672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:29 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Volume volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c (5fcee29d-4f98-44a4-ae44-802ae8f97e6c): created successfully Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f368a4e-34f2-4e4f-8a72-7b58b5575672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Flow 'volume_create_manager' (ba281a0b-413f-4aa3-a4b5-b9c38007ee48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:29 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-3a01ee60-21d3-4bb2-bd62-680119af2372 tempest-ProjectMemberTests-150498844 None] Created volume successfully. Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Creating offline snapshot 76b395e3-3cea-4e39-88b5-eed557438ab0 of volume 5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f321485-5092-488b-90d7-0625400ac7b9]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:29 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:29 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c Sep 17 15:18:29 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:30 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" returned: 0 in 0.364s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:30 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 1G Sep 17 15:18:30 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:30 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 1G" returned: 0 in 0.378s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:30 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 Sep 17 15:18:30 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:30 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0" returned: 0 in 0.298s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:30 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 is being set with open permissions: ugo+rw Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:30 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 Sep 17 15:18:30 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:30 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:30 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0" returned: 0 in 0.238s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:31 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info Sep 17 15:18:31 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:31 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:31 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info is being set with open permissions: ugo+rw Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:31 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info Sep 17 15:18:31 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:31 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.846s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:31 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0a6165fd-7b76-44cf-9475-8c362ccdd362 tempest-ProjectMemberTests-150498844 None] Create snapshot completed successfully Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-76b395e3-3cea-4e39-88b5-eed557438ab0-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-76b395e3-3cea-4e39-88b5-eed557438ab0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-76b395e3-3cea-4e39-88b5-eed557438ab0" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-76b395e3-3cea-4e39-88b5-eed557438ab0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Deleting offline snapshot 76b395e3-3cea-4e39-88b5-eed557438ab0 of volume 5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] snapshot_file for this snap is: volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c09f83-28f6-4795-841b-020d91475213]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:31 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:32 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 Sep 17 15:18:32 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:32 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b70fa-8c81-4d2f-a102-f38488249de1]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:32 devstack sudo[104146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c Sep 17 15:18:32 devstack sudo[104146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:32 devstack sudo[104146]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" returned: 0 in 0.354s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:32 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:32 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 Sep 17 15:18:32 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:33 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0" returned: 0 in 0.320s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:33 devstack sudo[104157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0 Sep 17 15:18:33 devstack sudo[104157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:33 devstack sudo[104157]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c.76b395e3-3cea-4e39-88b5-eed557438ab0" returned: 0 in 0.258s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-76b395e3-3cea-4e39-88b5-eed557438ab0" released by "_delete_snapshot" :: held 1.375s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" released by "delete_snapshot" :: held 1.398s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Created reservations ['380576f4-bfc0-4050-85b1-64e9ac011e45', '0e8258fc-0e6a-433a-9837-ae5f5072d362', '6120b41d-87f7-4d99-92ea-cfceda5673ba', 'f949f3cb-fa0e-4e8b-a3c5-5f3ca9cb2a97'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:33 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Delete snapshot completed successfully. Sep 17 15:18:33 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-af716e9e-06a3-44f5-ba99-a2b8b2714dd8 tempest-ProjectMemberTests-150498844 None] Lock "cinder-76b395e3-3cea-4e39-88b5-eed557438ab0-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-5fcee29d-4f98-44a4-ae44-802ae8f97e6c-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "cinder-5fcee29d-4f98-44a4-ae44-802ae8f97e6c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Acquiring lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[772308a3-429d-4860-8227-b280322b0b0e]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:34 devstack sudo[104160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c Sep 17 15:18:34 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:34 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" returned: 0 in 0.357s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:34 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c Sep 17 15:18:34 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:34 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "cinder-quobyte-5fcee29d-4f98-44a4-ae44-802ae8f97e6c" released by "delete_volume" :: held 0.662s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Created reservations ['d44d73dd-255e-4857-b5ab-11c476f81d07', 'c13699f5-8292-42a9-a8af-6e1f8d409b1d', '299eaf0f-ae8f-4c93-942a-9587febf1010', 'da2a70bf-ce4d-46d2-8627-e111b9e3504b'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:34 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:34 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:34 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:35 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:35 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:35 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:35 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Deleted volume successfully. Sep 17 15:18:35 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-08bcb58c-ed0a-4909-9a62-73052f6e40af tempest-ProjectMemberTests-150498844 None] Lock "cinder-5fcee29d-4f98-44a4-ae44-802ae8f97e6c-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (21d44e4a-94af-4ad3-ad9d-73585a1b3232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe1c81e-7ffe-4b04-b6f4-36c34f82901b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fe1c81e-7ffe-4b04-b6f4-36c34f82901b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535389058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ed48d6-73ba-463c-94d8-e973117b764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:39Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af8beae-0c62-4b16-930a-d404c544b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af8beae-0c62-4b16-930a-d404c544b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9644a398-b8a9-4c54-bc48-05de26c9bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9644a398-b8a9-4c54-bc48-05de26c9bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2ed48d6-73ba-463c-94d8-e973117b764d', 'volume_name': 'volume-f2ed48d6-73ba-463c-94d8-e973117b764d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0782f-3dfd-4771-b450-8b4837ccb8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aa0782f-3dfd-4771-b450-8b4837ccb8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d923fe-e1c4-4082-a149-c20f738a5701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:38 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Volume f2ed48d6-73ba-463c-94d8-e973117b764d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2ed48d6-73ba-463c-94d8-e973117b764d', 'volume_size': 1} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535389058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2ed48d6-73ba-463c-94d8-e973117b764d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:39Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Creating volume f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:38 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:38 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:38 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d 1073741824 Sep 17 15:18:38 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:39 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d 1073741824" returned: 0 in 0.425s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:39 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d Sep 17 15:18:39 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:39 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d" returned: 0 in 0.254s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5d923fe-e1c4-4082-a149-c20f738a5701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2ed48d6-73ba-463c-94d8-e973117b764d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2547e-08bc-4714-9bc5-e351a558528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:39 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Volume volume-f2ed48d6-73ba-463c-94d8-e973117b764d (f2ed48d6-73ba-463c-94d8-e973117b764d): created successfully Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece2547e-08bc-4714-9bc5-e351a558528d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (21d44e4a-94af-4ad3-ad9d-73585a1b3232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:39 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a2b1bf63-7a7b-4132-8c3d-6cb0892de8ad tempest-ProjectReaderTests-2109724262 None] Created volume successfully. Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Creating offline snapshot b42646e9-7072-4ff6-a236-f49d0a25e536 of volume f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[2426d079-7f32-4588-81d5-bbb439627904]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:39 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:40 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d Sep 17 15:18:40 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:40 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:40 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 1G Sep 17 15:18:40 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:40 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 1G" returned: 0 in 0.374s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ed48d6-73ba-463c-94d8-e973117b764d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:40 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ed48d6-73ba-463c-94d8-e973117b764d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 Sep 17 15:18:40 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:40 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2ed48d6-73ba-463c-94d8-e973117b764d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536" returned: 0 in 0.295s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:40 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 is being set with open permissions: ugo+rw Sep 17 15:18:40 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:40 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 Sep 17 15:18:40 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:41 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:41 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info Sep 17 15:18:41 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:41 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:41 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info is being set with open permissions: ugo+rw Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:41 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info Sep 17 15:18:41 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:41 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.info" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:41 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:41 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-91f51ff3-2c3b-4222-a787-67fcb407e736 tempest-ProjectReaderTests-2109724262 None] Create snapshot completed successfully Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-b42646e9-7072-4ff6-a236-f49d0a25e536-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-b42646e9-7072-4ff6-a236-f49d0a25e536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-b42646e9-7072-4ff6-a236-f49d0a25e536" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-b42646e9-7072-4ff6-a236-f49d0a25e536" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Deleting offline snapshot b42646e9-7072-4ff6-a236-f49d0a25e536 of volume f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] snapshot_file for this snap is: volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0874e1d3-40c1-42bf-8737-eb310ffb1c81]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:42 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 Sep 17 15:18:42 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:42 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2ed48d6-73ba-463c-94d8-e973117b764d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff074e9f-6c3a-4c1a-ba20-08d8343ce373]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:42 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d Sep 17 15:18:42 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:42 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d" returned: 0 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:42 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:42 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 Sep 17 15:18:42 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:43 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536" returned: 0 in 0.335s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:43 devstack sudo[104221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536 Sep 17 15:18:43 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:43 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d.b42646e9-7072-4ff6-a236-f49d0a25e536" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-b42646e9-7072-4ff6-a236-f49d0a25e536" released by "_delete_snapshot" :: held 1.397s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" released by "delete_snapshot" :: held 1.417s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Created reservations ['e58df7d0-06dc-4bdb-aa01-82538ef12d76', '39d2c915-a6c8-469e-b0a3-951cca3b5fc7', '52b5732b-510a-461b-b5ff-0aec2c98d4e7', '068c7983-b164-42e4-b41d-739d5e9d2054'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:43 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Delete snapshot completed successfully. Sep 17 15:18:43 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-edccfbe0-eef8-42e1-ac2a-65db21ae21bd tempest-ProjectReaderTests-2109724262 None] Lock "cinder-b42646e9-7072-4ff6-a236-f49d0a25e536-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-f2ed48d6-73ba-463c-94d8-e973117b764d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "cinder-f2ed48d6-73ba-463c-94d8-e973117b764d-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715d7f9-8e30-4470-bd2c-313894bab112]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:44 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d Sep 17 15:18:44 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:44 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:44 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d Sep 17 15:18:44 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:44 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f2ed48d6-73ba-463c-94d8-e973117b764d" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f2ed48d6-73ba-463c-94d8-e973117b764d" released by "delete_volume" :: held 0.669s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:44 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Created reservations ['29821c85-0adf-46b0-8a7b-01f2a4b3a9a7', '6f5ecc26-5fd1-420f-84c3-d7130da5dc54', 'c3293b17-2c21-401e-b1e9-c88e69d2afa1', 'e3d6c7d4-85e6-4a1d-9164-0ebff0318f2d'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:45 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:45 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:45 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.251s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:45 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Deleted volume successfully. Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1bb888a2-44a2-4e68-8a70-af6e61fd34bc tempest-ProjectReaderTests-2109724262 None] Lock "cinder-f2ed48d6-73ba-463c-94d8-e973117b764d-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (33e8acf8-b9b4-4157-92c6-23b59b6a204b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c62b58-b749-43cb-9271-f363682902e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c62b58-b749-43cb-9271-f363682902e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805310934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc449e7-4804-477b-94f8-a9857a04a55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:46Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969e5e91-d8ed-40e3-a80a-cc944575bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (969e5e91-d8ed-40e3-a80a-cc944575bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a102869-e75b-4e20-9b37-9813401ad3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a102869-e75b-4e20-9b37-9813401ad3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc449e7-4804-477b-94f8-a9857a04a55b', 'volume_name': 'volume-3bc449e7-4804-477b-94f8-a9857a04a55b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01143011-3115-4029-bd36-2889bcbcea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01143011-3115-4029-bd36-2889bcbcea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff60cc-9ebc-4f1d-bf6e-4a5930539d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:45 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Volume 3bc449e7-4804-477b-94f8-a9857a04a55b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc449e7-4804-477b-94f8-a9857a04a55b', 'volume_size': 1} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-805310934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc449e7-4804-477b-94f8-a9857a04a55b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:46Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Creating volume 3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:45 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:45 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:45 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b 1073741824 Sep 17 15:18:45 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:46 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b 1073741824" returned: 0 in 0.419s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:46 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b Sep 17 15:18:46 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:46 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aff60cc-9ebc-4f1d-bf6e-4a5930539d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc449e7-4804-477b-94f8-a9857a04a55b', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb1d0bf-a2e0-4271-a837-eea1c1ca7787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:46 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Volume volume-3bc449e7-4804-477b-94f8-a9857a04a55b (3bc449e7-4804-477b-94f8-a9857a04a55b): created successfully Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb1d0bf-a2e0-4271-a837-eea1c1ca7787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:46 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (33e8acf8-b9b4-4157-92c6-23b59b6a204b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:46 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e4d92429-e390-4fa2-9c1c-aeb511f0e997 tempest-ProjectReaderTests-2109724262 None] Created volume successfully. Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Creating offline snapshot bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 of volume 3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e283b5b7-39a4-4aa1-bf22-5a496370ce2d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:47 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b Sep 17 15:18:47 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:47 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b" returned: 0 in 0.377s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:47 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 1G Sep 17 15:18:47 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:47 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 1G" returned: 0 in 0.392s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:47 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc449e7-4804-477b-94f8-a9857a04a55b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:47 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc449e7-4804-477b-94f8-a9857a04a55b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 Sep 17 15:18:47 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:48 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bc449e7-4804-477b-94f8-a9857a04a55b -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" returned: 0 in 0.287s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 is being set with open permissions: ugo+rw Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:48 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 Sep 17 15:18:48 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:48 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" returned: 0 in 0.247s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:48 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info Sep 17 15:18:48 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:48 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:48 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info is being set with open permissions: ugo+rw Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:48 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info Sep 17 15:18:48 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:48 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:48 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.883s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:48 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-88a9e2b8-91bd-4791-924c-d5b2b794563d tempest-ProjectReaderTests-2109724262 None] Create snapshot completed successfully Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Deleting offline snapshot bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 of volume 3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] snapshot_file for this snap is: volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4c4f5d-aeee-4185-b7e9-efad388bfc91]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:49 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 Sep 17 15:18:49 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:49 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" returned: 0 in 0.358s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bc449e7-4804-477b-94f8-a9857a04a55b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fbc46d-36a3-461f-b470-11983308a6f7]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:49 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b Sep 17 15:18:49 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:49 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:49 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:50 devstack sudo[104314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 Sep 17 15:18:50 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:50 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:50 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22 Sep 17 15:18:50 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:50 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b.bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" returned: 0 in 0.246s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22" released by "_delete_snapshot" :: held 1.375s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" released by "delete_snapshot" :: held 1.398s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Created reservations ['8edb0dfa-210f-4cf7-8333-dd13d7ed82b9', 'b5b2112b-f621-4f0b-988d-8c3300a6128b', '5714ee43-f3ee-4883-b4fc-22faf348cc26', 'ba3e375f-8a59-4b24-884b-d08b235f0810'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:50 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Delete snapshot completed successfully. Sep 17 15:18:50 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-a57c54fb-329d-4d55-a50f-5ec390fab889 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-bf7b7fd5-c1f2-4e4a-bd4b-744098836d22-delete_snapshot" released by "delete_snapshot" :: held 1.546s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-3bc449e7-4804-477b-94f8-a9857a04a55b-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "cinder-3bc449e7-4804-477b-94f8-a9857a04a55b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" acquired by "delete_volume" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bd2cb-3338-4acb-aabf-eec5b6f847b6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:51 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b Sep 17 15:18:51 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:51 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:51 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:51 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b Sep 17 15:18:51 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:52 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-3bc449e7-4804-477b-94f8-a9857a04a55b" returned: 0 in 0.244s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-3bc449e7-4804-477b-94f8-a9857a04a55b" released by "delete_volume" :: held 0.673s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Created reservations ['92ec8a9f-37bf-4aeb-aa2a-bb81fec9c350', '4a830a53-86e8-48e6-a5e6-17ca8ef38de0', 'b8efe18a-4233-48a7-b2eb-30e487a836eb', 'c3300979-8d46-434f-9030-e9667755daae'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:52 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:52 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:52 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:52 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Deleted volume successfully. Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-d72626a6-91a8-44a0-a31d-231335a5eb7f tempest-ProjectReaderTests-2109724262 None] Lock "cinder-3bc449e7-4804-477b-94f8-a9857a04a55b-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (d4ac1786-441a-40f1-847d-48db7181bf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a21e6c0-1004-43b8-9e02-5cf5d891d116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a21e6c0-1004-43b8-9e02-5cf5d891d116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233213751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaac6090-f730-45a9-8099-d466264bccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:53Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb034f7f-6e06-494a-afe5-14a2ab4202c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb034f7f-6e06-494a-afe5-14a2ab4202c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3543221-68dc-4e76-8a09-82d12a820f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3543221-68dc-4e76-8a09-82d12a820f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaac6090-f730-45a9-8099-d466264bccfb', 'volume_name': 'volume-aaac6090-f730-45a9-8099-d466264bccfb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fba95-17e6-4c5f-bc81-0ecbafb96aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fba95-17e6-4c5f-bc81-0ecbafb96aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a78b4d-2ede-4443-95e6-b311920309e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:52 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Volume aaac6090-f730-45a9-8099-d466264bccfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaac6090-f730-45a9-8099-d466264bccfb', 'volume_size': 1} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1233213751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaac6090-f730-45a9-8099-d466264bccfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:18:53Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Creating volume aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:18:52 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:18:52 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:53 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb 1073741824 Sep 17 15:18:53 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:53 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb 1073741824" returned: 0 in 0.416s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:53 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb Sep 17 15:18:53 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:53 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a78b4d-2ede-4443-95e6-b311920309e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaac6090-f730-45a9-8099-d466264bccfb', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d1e09-a3c0-4020-9307-c170f9a7ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:53 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Volume volume-aaac6090-f730-45a9-8099-d466264bccfb (aaac6090-f730-45a9-8099-d466264bccfb): created successfully Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb5d1e09-a3c0-4020-9307-c170f9a7ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:53 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (d4ac1786-441a-40f1-847d-48db7181bf51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:53 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-d14fd54b-ecec-428b-8291-5b3eef77de26 tempest-ProjectReaderTests-2109724262 None] Created volume successfully. Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Creating offline snapshot a1ae3838-56b8-4824-a386-5bd037e0793e of volume aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[977c5fa5-8eea-4a05-989f-86cd68076697]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:54 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb Sep 17 15:18:54 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:54 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb" returned: 0 in 0.365s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:54 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e 1G Sep 17 15:18:54 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:54 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e 1G" returned: 0 in 0.373s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:54 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaac6090-f730-45a9-8099-d466264bccfb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:54 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaac6090-f730-45a9-8099-d466264bccfb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e Sep 17 15:18:54 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:55 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aaac6090-f730-45a9-8099-d466264bccfb -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e" returned: 0 in 0.285s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:55 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e is being set with open permissions: ugo+rw Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:55 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e Sep 17 15:18:55 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:55 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e" returned: 0 in 0.240s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:55 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info Sep 17 15:18:55 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:55 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:55 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info is being set with open permissions: ugo+rw Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:55 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info Sep 17 15:18:55 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:55 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.info" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:55 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.824s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:55 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-679bb111-55bc-4d92-9151-b636dd1022e5 tempest-ProjectReaderTests-2109724262 None] Create snapshot completed successfully Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-a1ae3838-56b8-4824-a386-5bd037e0793e-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-a1ae3838-56b8-4824-a386-5bd037e0793e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-a1ae3838-56b8-4824-a386-5bd037e0793e" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-a1ae3838-56b8-4824-a386-5bd037e0793e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Deleting offline snapshot a1ae3838-56b8-4824-a386-5bd037e0793e of volume aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] snapshot_file for this snap is: volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f1506-3e44-4250-ae80-519df8916c20]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:56 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e Sep 17 15:18:56 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:56 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aaac6090-f730-45a9-8099-d466264bccfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96296c-a066-48d7-bfdd-757b619258eb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:56 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb Sep 17 15:18:56 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:56 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:57 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb" returned: 0 in 0.350s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:57 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:57 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:57 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e Sep 17 15:18:57 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:57 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.247s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_service.periodic_task [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] Running periodic task VolumeManager._thread_info {{(pid=85963) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread count: 28 {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-f178d838-4ef6-42fd-b21f-edc351bf4b43 None None] thread info: [<_MainThread(MainThread, started 131413881897088)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=85963) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 17 15:18:57 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e" returned: 0 in 0.334s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:57 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e Sep 17 15:18:57 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:57 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb.a1ae3838-56b8-4824-a386-5bd037e0793e" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-a1ae3838-56b8-4824-a386-5bd037e0793e" released by "_delete_snapshot" :: held 1.360s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" released by "delete_snapshot" :: held 1.382s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Created reservations ['3cada675-cb39-4ac2-a531-52aa1c8ca9a1', 'c3944afc-e61f-4cd3-8273-1df491bb5bc9', 'b8d5f462-a128-4522-a34c-335f971ac488', '1c1d549f-4cf7-48a8-8e80-fb265b390be9'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:57 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Delete snapshot completed successfully. Sep 17 15:18:57 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-de9fa929-0376-49c9-ae18-d0ee4aa0f742 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-a1ae3838-56b8-4824-a386-5bd037e0793e-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-aaac6090-f730-45a9-8099-d466264bccfb-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-aaac6090-f730-45a9-8099-d466264bccfb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" acquired by "delete_volume" :: waited 0.014s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aaeca77-e62b-4dd7-8158-59f99de25d3f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:58 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb Sep 17 15:18:58 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:58 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb" returned: 0 in 0.348s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:58 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:58 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb Sep 17 15:18:58 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:59 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-aaac6090-f730-45a9-8099-d466264bccfb" returned: 0 in 0.238s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-aaac6090-f730-45a9-8099-d466264bccfb" released by "delete_volume" :: held 0.642s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Created reservations ['b62ead88-b7ef-49b1-ab04-26dc56dd5a52', 'c816639b-4f38-434a-947a-28bfa795d9ae', 'df1414df-507b-4b8d-89fe-6f63ed46f3c3', '68d135f4-8ee6-43bb-ae62-7688b50b716f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:18:59 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:18:59 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:18:59 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:18:59 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Deleted volume successfully. Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-8508a601-383e-44c3-853f-2508471a3e54 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-aaac6090-f730-45a9-8099-d466264bccfb-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (6cf59ed6-1182-4807-b0f0-3e8047c1bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58318e4b-6b5e-4bb3-8324-d2dac70bea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58318e4b-6b5e-4bb3-8324-d2dac70bea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692596073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f179440a-542a-4fd9-8e0c-d8e1a021f87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:19:00Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dc1bef-4046-458a-961b-e51edce16f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25dc1bef-4046-458a-961b-e51edce16f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c79466-a6f5-40ce-879a-47f8c8cf64a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c79466-a6f5-40ce-879a-47f8c8cf64a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f179440a-542a-4fd9-8e0c-d8e1a021f87d', 'volume_name': 'volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:18:59 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb3e88-5761-4476-8940-75e85381ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cfb3e88-5761-4476-8940-75e85381ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129d9fd3-a5bc-40e7-8aa6-9ce258e035ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Volume f179440a-542a-4fd9-8e0c-d8e1a021f87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d', 'volume_size': 1} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-692596073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f179440a-542a-4fd9-8e0c-d8e1a021f87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:19:00Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Creating volume f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:19:00 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:00 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d 1073741824 Sep 17 15:19:00 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:00 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d 1073741824" returned: 0 in 0.397s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:00 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d Sep 17 15:19:00 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:00 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129d9fd3-a5bc-40e7-8aa6-9ce258e035ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc02bf-5c2c-46a8-9312-6ea33b20d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:00 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Volume volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d (f179440a-542a-4fd9-8e0c-d8e1a021f87d): created successfully Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcbc02bf-5c2c-46a8-9312-6ea33b20d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:00 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (6cf59ed6-1182-4807-b0f0-3e8047c1bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:19:00 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-37539005-1725-4c26-99ec-5ab99546762a tempest-ProjectReaderTests-2109724262 None] Created volume successfully. Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Creating offline snapshot c10b0f0d-57be-4147-a38d-dcf0fb330b59 of volume f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2136621-71c0-4480-a2a6-c0540c2f02bb]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:01 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d Sep 17 15:19:01 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:01 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d" returned: 0 in 0.353s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:01 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 1G Sep 17 15:19:01 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:01 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 1G" returned: 0 in 0.380s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:01 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:01 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 Sep 17 15:19:01 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:02 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59" returned: 0 in 0.277s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 is being set with open permissions: ugo+rw Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:02 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 Sep 17 15:19:02 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:02 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59" returned: 0 in 0.245s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:02 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info Sep 17 15:19:02 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:02 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info" returned: 0 in 0.253s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:02 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info is being set with open permissions: ugo+rw Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:02 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info Sep 17 15:19:02 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:02 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:02 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:02 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-e654c97f-5344-4b53-9245-24d7b76c93d5 tempest-ProjectReaderTests-2109724262 None] Create snapshot completed successfully Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-c10b0f0d-57be-4147-a38d-dcf0fb330b59-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-c10b0f0d-57be-4147-a38d-dcf0fb330b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-c10b0f0d-57be-4147-a38d-dcf0fb330b59" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-c10b0f0d-57be-4147-a38d-dcf0fb330b59" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Deleting offline snapshot c10b0f0d-57be-4147-a38d-dcf0fb330b59 of volume f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] snapshot_file for this snap is: volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd85bb28-bb73-48ba-9e75-63b202a5dec3]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:03 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 Sep 17 15:19:03 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:03 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59" returned: 0 in 0.352s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1b6563-1b87-4598-bfa6-41715840a15f]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:03 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:03 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d Sep 17 15:19:03 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:04 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:04 devstack sudo[104448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 Sep 17 15:19:04 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:04 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59" returned: 0 in 0.338s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:04 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59 Sep 17 15:19:04 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:04 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d.c10b0f0d-57be-4147-a38d-dcf0fb330b59" returned: 0 in 0.243s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-c10b0f0d-57be-4147-a38d-dcf0fb330b59" released by "_delete_snapshot" :: held 1.372s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" released by "delete_snapshot" :: held 1.395s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Created reservations ['d532673c-52ef-4a9a-abad-c1f97e86e3c1', '662e03aa-44b3-4fa1-a2ff-4087520d32dc', 'ebb3bead-3e0e-4a01-83ec-79738c0139f2', 'a1e8f609-568a-4dfe-9b61-7bc1d9ec8146'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:19:04 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Delete snapshot completed successfully. Sep 17 15:19:04 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-c0a5189d-feaa-42dd-bb87-480e2b814354 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-c10b0f0d-57be-4147-a38d-dcf0fb330b59-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-f179440a-542a-4fd9-8e0c-d8e1a021f87d-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-f179440a-542a-4fd9-8e0c-d8e1a021f87d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[0154e90d-3b43-4f4b-91f8-b6ee5fbad398]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:05 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d Sep 17 15:19:05 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:05 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d" returned: 0 in 0.359s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:05 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:05 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d Sep 17 15:19:05 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:06 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-f179440a-542a-4fd9-8e0c-d8e1a021f87d" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-f179440a-542a-4fd9-8e0c-d8e1a021f87d" released by "delete_volume" :: held 0.658s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Created reservations ['f4e23e76-8b3c-489a-8edb-0425f06bc884', '3ee03625-53b9-4499-912a-5f3ded1b1230', 'd7054faa-c80a-49d0-bb03-7b8cfeef62b8', '3d14e04a-368f-46d5-8396-099da481a440'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:06 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:19:06 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:06 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.239s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:19:06 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Deleted volume successfully. Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-ea48bf4c-0420-446c-a828-e70f8eda1e38 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-f179440a-542a-4fd9-8e0c-d8e1a021f87d-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.flows.manager.create_volume [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=85963) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (5ff4c1eb-586e-46db-8b4d-afb13f6f8f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26315c2-3f20-4a1b-a823-c98321dcc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26315c2-3f20-4a1b-a823-c98321dcc836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643407940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd2305c-5c40-4cf6-b29a-57e29e1ba2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:19:07Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4af72e-d4cf-4822-a6f4-3475c41a61af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4af72e-d4cf-4822-a6f4-3475c41a61af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb5f5f5-2c6b-4046-a1bf-ee81da453e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb5f5f5-2c6b-4046-a1bf-ee81da453e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd2305c-5c40-4cf6-b29a-57e29e1ba2b2', 'volume_name': 'volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2e5b9-0008-4696-86a3-c78ea3b722de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe2e5b9-0008-4696-86a3-c78ea3b722de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eaf53d4-8a5f-4583-a0ce-baa35a1e9fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:06 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Volume acd2305c-5c40-4cf6-b29a-57e29e1ba2b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2', 'volume_size': 1} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T13:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1643407940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd2305c-5c40-4cf6-b29a-57e29e1ba2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d45dfe8da8eb4a9f9a4b2332d525d5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T13:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T13:19:07Z,use_quota=True,user_id='f0194a52b9ba40949baf60a0fe52ddbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2),volume_type_id=4c79b1c6-3c39-46ee-8d0d-d19a9bfff1a2)}" {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Creating volume acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Selected osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 as target Quobyte volume. {{(pid=85963) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 17 15:19:06 devstack cinder-volume[85963]: INFO cinder.volume.drivers.remotefs [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] casted to osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48 Sep 17 15:19:06 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 1073741824 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:07 devstack sudo[104470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 1073741824 Sep 17 15:19:07 devstack sudo[104470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:07 devstack sudo[104470]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 1073741824" returned: 0 in 0.404s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:07 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 Sep 17 15:19:07 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:07 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" returned: 0 in 0.237s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'} {{(pid=85963) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eaf53d4-8a5f-4583-a0ce-baa35a1e9fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2', 'volume_size': 1}' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d227c8cc-36a8-4fc9-b6ea-aa6a7d061ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 17 15:19:07 devstack cinder-volume[85963]: INFO cinder.volume.flows.manager.create_volume [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Volume volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 (acd2305c-5c40-4cf6-b29a-57e29e1ba2b2): created successfully Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d227c8cc-36a8-4fc9-b6ea-aa6a7d061ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=85963) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 17 15:19:07 devstack cinder-volume[85963]: DEBUG cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Flow 'volume_create_manager' (5ff4c1eb-586e-46db-8b4d-afb13f6f8f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=85963) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 17 15:19:07 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-0216e6a0-5e99-44b1-928c-68874082a8a2 tempest-ProjectReaderTests-2109724262 None] Created volume successfully. Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Creating offline snapshot ba704441-816e-46f5-aa0b-9fdba43bbdf4 of volume acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd45bf4-1225-466a-903a-20eaea8e5a41]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:08 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 Sep 17 15:19:08 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:08 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" returned: 0 in 0.356s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 1G {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:08 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 1G Sep 17 15:19:08 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:08 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 1G" returned: 0 in 0.370s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:08 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:08 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 Sep 17 15:19:08 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:09 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 -F qcow2 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4" returned: 0 in 0.291s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 is being set with open permissions: ugo+rw Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:09 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 Sep 17 15:19:09 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:09 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4" returned: 0 in 0.250s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:09 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info Sep 17 15:19:09 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:09 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:09 devstack cinder-volume[85963]: WARNING cinder.volume.drivers.remotefs [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info is being set with open permissions: ugo+rw Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:09 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info Sep 17 15:19:09 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:09 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.info" returned: 0 in 0.242s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:09 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.843s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:09 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-a1ba555e-3d1f-4916-9ece-8ce51402e399 tempest-ProjectReaderTests-2109724262 None] Create snapshot completed successfully Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-ba704441-816e-46f5-aa0b-9fdba43bbdf4-delete_snapshot" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-ba704441-816e-46f5-aa0b-9fdba43bbdf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" by "delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-ba704441-816e-46f5-aa0b-9fdba43bbdf4" by "_delete_snapshot" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-ba704441-816e-46f5-aa0b-9fdba43bbdf4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Deleting offline snapshot ba704441-816e-46f5-aa0b-9fdba43bbdf4 of volume acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] snapshot_file for this snap is: volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[18532609-9fe9-439c-958e-ec8afc10228d]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:10 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 Sep 17 15:19:10 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:10 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4" returned: 0 in 0.351s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.remotefs [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=85963) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[222332d2-1fb1-40d0-8182-89b3a1a0a4a6]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:10 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:10 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 Sep 17 15:19:10 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:11 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" returned: 0 in 0.360s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:11 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 Sep 17 15:19:11 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:11 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4" returned: 0 in 0.327s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:11 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4 Sep 17 15:19:11 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:11 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2.ba704441-816e-46f5-aa0b-9fdba43bbdf4" returned: 0 in 0.236s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-ba704441-816e-46f5-aa0b-9fdba43bbdf4" released by "_delete_snapshot" :: held 1.368s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" released by "delete_snapshot" :: held 1.391s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Created reservations ['824a2216-f562-47ce-9ba8-0b582143375b', 'ffe9c651-3688-48c0-ac05-ff4e828c51cb', 'e4470bc0-60a5-41e6-8157-98d4c8885fbe', '4f207009-fc1f-4dda-95f2-ccd4e2040430'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:19:11 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Delete snapshot completed successfully. Sep 17 15:19:11 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-320401fc-11fe-4f25-9217-d4e52a1ac30d tempest-ProjectReaderTests-2109724262 None] Lock "cinder-ba704441-816e-46f5-aa0b-9fdba43bbdf4-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2-delete_volume" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" by "delete_volume" {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" acquired by "delete_volume" :: waited 0.016s {{(pid=85963) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG oslo.privsep.daemon [-] privsep: reply[34124ea6-65af-4a6d-9f65-b5e6d47b7010]: (4, 'qcow2') {{(pid=87605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:12 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 Sep 17 15:19:12 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:12 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" returned: 0 in 0.346s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:12 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:12 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2 Sep 17 15:19:12 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:13 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3/volume-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" returned: 0 in 0.241s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-quobyte-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2" released by "delete_volume" :: held 0.651s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.quota [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Created reservations ['c511c7da-aee5-4b2d-a52c-81059803534d', 'fcd8645f-ecaa-4d7e-ac0e-6addfb1347fb', '3a417910-4c95-45e1-9cb3-2cb85d545655', '70021f61-5761-4084-a293-5cf18096244f'] {{(pid=85963) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48': None} {{(pid=85963) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.volume.drivers.quobyte [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5437f2da-8271-40f8-a8e8-0bed4fd4ee48'] {{(pid=85963) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.lockutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85963) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 17 15:19:13 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3 Sep 17 15:19:13 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 17 15:19:13 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG oslo_concurrency.processutils [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/80052dbff063a5f96ec7944dd3b93ad3" returned: 0 in 0.248s {{(pid=85963) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.manager [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Notifying Schedulers of capabilities ... {{(pid=85963) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 17 15:19:13 devstack cinder-volume[85963]: INFO cinder.volume.manager [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Deleted volume successfully. Sep 17 15:19:13 devstack cinder-volume[85963]: DEBUG cinder.coordination [None req-1ddf6778-b295-492c-b7e3-3cc9959b3749 tempest-ProjectReaderTests-2109724262 None] Lock "cinder-acd2305c-5c40-4cf6-b29a-57e29e1ba2b2-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=85963) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 17 15:19:23 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=103,cinder:INSERT=42,cinder:UPDATE=136,cinder:DELETE=12 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 17 15:19:23 devstack cinder-volume[85963]: DEBUG dbcounter [-] [85963] Writing DB stats cinder:SELECT=114,cinder:DELETE=11,cinder:INSERT=37,cinder:UPDATE=144 {{(pid=85963) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}